FILE_IO(3)

πŸ“¦
version 3.2 Β· 2 versions
  • 3.2 Β· debian trixie, fedora 43, fedora 44, ubuntu noble, ubuntu questing, ubuntu resolute (latest)
  • 3.2 Β· ubuntu stonking
, in debian trixie, fedora 43, fedora 44, ubuntu noble, ubuntu questing, ubuntu resolute

πŸ’– FILE_IO(3) β€” the file_io module, bestie edition πŸ’–

okay so real talk, this is the page for nfstest.file_io, a.k.a. the File I/O module from file_io version 1.3, and yes she's iconic, yes she's in section 3 of the manual, and yes we're gonna get through every single line together. grab a snack. πŸ“


✨ NAME ✨

nfstest.file_io β€” File I/O module. that's it, that's the name, short and slay. πŸ‘‘


🌸 DESCRIPTION 🌸

so what does she do? she gives you an interface to create and manipulate files of different types. the arguments let you run for a specified period of time, and also let you run multiple processes. here's the cute part: each process modifies a single file at a time, and the file name space is different for each process, so there are no collisions between two different processes modifying the same file. no drama, no fighting over the same file, we love a peaceful household. 🫢

File types she's serving:

  • Regular file
  • Hard link
  • Symbolic link

File operations on the menu:

  • Open (create or re-open)
  • Open downgrade
    • This is done by opening the file for read and write, then the file is opened again as read only and finally closing the read and write file descriptor
  • Read (sequential or random access)
  • Write (sequential or random access)
  • Remove
  • Rename
  • Truncate (path or file descriptor)
  • Readdir
  • Lock
  • Unlock
  • Tlock

πŸŽ€ CLASSES πŸŽ€

πŸ’… class FileIO(baseobj.BaseObj)

the FileIO object. main character energy, fr fr.

Usage:

from nfstest.file_io import FileIO

# Instantiate FileIO object given top level directory
x = FileIO(datadir="/tmp/data")

# Run workload creating the top level directory if necessary
x.run()

Methods defined here:


__del__(self)

Destructor. she says goodbye when it's time to go. πŸ‘‹


__init__(self, **kwargs)

Constructor. Initialize object's private data.

okay bestie, here's the full kwargs menu, and I am not skipping a single one, not on my watch:

  • datadir β€” Top level directory where files will be created, it will be created if it does not exist
  • seed β€” Seed to initialized the random number generator [default: automatically generated]
  • nprocs β€” Number of processes to use [default: 1]
  • runtime β€” Run time [default: 0 (indefinitely)]
  • verbose β€” Verbose level: none|info|debug|dbg1-7|all [default: 'none']
  • exiterr β€” Exit on first error [default: False]
  • read β€” Read file percentage [default: 40.0]
  • write β€” Write file percentage [default: 40.0]
  • rdwr β€” Read/write file percentage [default: 20.0]
  • randio β€” Random file access percentage [default: 50.0]
  • iodelay β€” Seconds to delay I/O operations [default: 0.0]
  • direct β€” Use direct I/O [default: False]
  • rdwronly β€” Use read and write only, no rename, remove, etc. [default: False]
  • create β€” Create file percentage [default: 5.0]
  • odgrade β€” Open downgrade percentage [default: 5.0]
  • osync β€” Open file with O_SYNC [default: 10.0]
  • fsync β€” Percentage of fsync after write [default: 2.0]
  • rename β€” Rename file percentage [default: 5.0]
  • remove β€” Remove file percentage [default: 5.0]
  • trunc β€” Truncate file percentage [default: 2.0]
  • ftrunc β€” Truncate opened file percentage [default: 2.0]
  • link β€” Create hard link percentage [default: 1.0]
  • slink β€” Create symbolic link percentage [default: 0.2]
  • readdir β€” List contents of directory percentage [default: 0.5]
  • lock β€” Lock file percentage [default: 20.0]
  • unlock β€” Unlock file percentage [default: 80.0]
  • tlock β€” Lock test percentage [default: 20.0]
  • lockfull β€” Lock full file percentage [default: 50.0]
  • minfiles β€” Minimum number of files to create before any file operation is executed [default: 10]
  • fsizeavg β€” File size average [default: 1m]
  • fsizedev β€” File size standard deviation [default: 256k]
  • rsize β€” Read block size [default: 64k]
  • rsizedev β€” Read block size standard deviation [default: 8k]
  • wsize β€” Write block size [default: 64k]
  • wsizedev β€” Write block size standard deviation [default: 8k]
  • sizemult β€” Size multiplier [default: 1.0]
  • createlog β€” Create log file [default: False]
  • createlogs β€” Create a log file for each process [default: False]
  • logdir β€” Log directory [default: '/tmp']

get_mountpoint(self)

Get mount point from data directory. detective work, but make it filesystem. πŸ”


run(self)

Main function where all processes are started. this is where the party actually begins. πŸŽ‰


run_process(self, tid=0)

Main loop for each process.


πŸ¦‹ class FileObj(baseobj.BaseObj)

Base class so objects will inherit the methods providing the string representation of the object and a simple debug printing and logging mechanism.

Usage:

from baseobj import BaseObj

# Named arguments
x = BaseObj(a=1, b=2)

# Dictionary argument
x = BaseObj({'a':1, 'b':2})

# Tuple arguments: first for keys and second for the values
x = BaseObj(['a', 'b'], [1, 2])

# All of the above will create an object having two attributes:
x.a = 1 and x.b = 2

# Add attribute name, this will be the only attribute to be displayed
x.set_attrlist("a")

# Add list of attribute names to be displayed in that order
x.set_attrlist(["a", "b"])

# Set attribute with ordered display rights
x.set_attr("a", 1)
# This is the same as
setattr(x, "a", 1) or x.a = 1
x.set_attrlist("a")

# Set attribute with switch duplicate
# The following creates an extra attribute "switch" with
# the same value as attribute "a":
#   x.a == x.switch
#   x.a is x.switch
x.set_attr("a", 1, switch=True)

# Make the current object flat by allowing all the attributes
# for the new attribute to be accessed directly by the current
# object so the following is True:
#   x.d == x.c.d
x.set_attr("c", BaseObj(d=11, e=22), switch=True)

# Set the comparison attribute so x == x.a is True
x.set_eqattr("a")

# Set verbose level of object's string representation
x.debug_repr(level)

# Set string format for verbose level 1
x.set_strfmt(1, "arg1:{0}")
# In the above example the first positional argument is "a"
# so the str(x) gives "arg1:1"

# Set attribute shared by all instances
# If a global or shared attribute is set on one instance,
# all other instances will have access to it:
#   y = BaseObj(d=2, e=3)
# then the following is true
#   x.g == y.g
#   x.g is y.g
x.set_global("g", 5)

# Set level mask to display all debug messages matching mask
x.debug_level(0xFF)

# Add a debug mapping for mask 0x100
x.debug_map(0x100, 'opts', "OPTS: ")

# Set global indentation to 4 spaces for dprint
x.dindent(4)

# Set global indentation to 4 spaces for displaying objects
x.sindent(4)

# Set global truncation to 64 for displaying string objects
x.strsize(64)

# Do not display timestamp for dprint messages
x.tstamp(enable=False)

# Change timestamp format to include the date
x.tstamp(fmt="{0:date:%Y-%m-%d %H:%M:%S.%q} ")

# Get timestamp if enabled, else return an empty string
out = x.timestamp()

# Open log file
x.open_log(logfile)

# Close log file
x.close_log()

# Write data to log file
x.write_log(data)

# Format the given arguments
out = x.format("{0:x} - {1}", 1, "hello")

# Format the object attributes set by set_attrlist()
out = x.format("{0:x} - {1}")

# Print debug message only if OPTS bitmap matches the current
# debug level mask
x.dprint("OPTS", "This is an OPTS debug message")

⭐ class TermSignal(builtins.Exception)

Exception to be raised on SIGTERM signal. she's the one who catches the vibe shift. 😭


🌈 FUNCTIONS 🌈

stop_handler(signum, frame)

Signal handler to catch SIGTERM and allow for graceful termination of subprocesses. no cap, she keeps everything tidy on the way out. 🧚


πŸ’œ SEE ALSO πŸ’œ


πŸ‘‘ BUGS πŸ‘‘

No known bugs. she's flawless and we're obsessed. πŸ’…βœ¨


πŸŽ€ AUTHOR πŸŽ€

Jorge Mora (mora@netapp.com). thank you for your service, king. 🫑


and that's the whole page bestie!! πŸ’– this was NFStest 3.2, dated 21 March 2023, and the manual page you just read is FILE_IO(3) β€” so go forth, create some files, no collisions, no stress, periodt. πŸŒΈπŸ¦‹β­

πŸ“¦ where this page comes from