STDA(1)

✨ STDA β€” Simple Tools for Data Analysis ✨

okay bestie, welcome to STDA(1), a User Commands situation πŸ’… this is the manual page for the stda package and we're gonna get you fluent in it, no cap.


🌸 NAME 🌸

stda β€” Simple Tools for Data Analysis (STDA) πŸŽ€


πŸ’– DESCRIPTION πŸ’–

so basically, STDA ships a lil collection of primary tools for data analysis. you can evaluate sums, averages, integrals, derivatives, histograms, or probability distribution functions of 1-d data, and eventually plot the results too. iconic behavior honestly ✨

the programs are stand-alone tools β€” they support the standard UNIX input and output pipelines β€” and they're intended for data processing from the command line. 🧚

heads up: all but one of the scripts use awk and core system utilities. for plotting you have to install Gnuplot (see http://gnuplot.info) since muplot is a wrapper around it. not optional, bestie, it's the whole plot vibe πŸ’€

in summary, the package provides utilities for straightforward analysis of data series where a complex analytical approach is not needed, and where an ultimate numerical precision with floating-point numbers is not critical. some general examples of application cases include:

  • evaluating usage statistics from server logfiles πŸ“Š
  • determining a response time distribution from a series of queries to a [remote] service 🌐
  • producing a plot from multiple data files 🎨
  • etc.

this software should be considered as an open project to be extended with new command-line driven utilities helpful for performing common data analysis tasks. any contributions and suggestions are welcome 🫢 (yes, yours too, main character).

following programs are included in the distribution:

  • maphimbu β€” histogram builder for 1-d numerical and text data
  • mintegrate β€” average/sum/integral/derivative of 1-d numerical data
  • mmval β€” find minimum and maximum value in a dataset
  • muplot β€” plot a multi-curve figure from multiple dataset using Gnuplot
  • nnum β€” produce a series of equally separated integers or floats
  • prefield β€” prepare input file for muplot to plot 2-d fields by arrows

πŸ”₯ EXAMPLES πŸ”₯

let's get into the receipts, periodt πŸ’…

  • evaluate the current apache2 logfile and make an unique list of the hostnames (respectively ip-addresses) sorted by the total number of their http requests:
maphimbu -rs2 /var/log/apache2/access.log
  • on a X terminal plot the probability function and the cumulative distribution function of a 'sin(x)' data sample:
nnum -3.14159 3.14159 0.00001 "sin(x)" "%.17f %.7f" | maphimbu
-d0.01 -x1 -ns1 | mintegrate -d0.01 -x1 -y3 -S | muplot lp -
1:3,4
not me piping four tools together like it's nothing 😭 that's the whole vibe though β€” UNIX pipelines ate and left no crumbs.

Copyright Β© 2009, 2011-2014 Dimitar Ivanov <dimitar.ivanov@mirendom.net>

License: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. πŸ’œ


and that's the whole page, bestie πŸ¦‹ this was stda 1.3.1, dated August 2014 β€” go forth and analyze some data, you've got this fr fr ⭐