Fsdb::F...atscores(3)

✨ okay bestie, welcome to the Fsdb::F...atscores(3) manual page 💖 — it’s from User Contributed Perl Documentation, and the star of the show is dbcolstatscores.

🌸 NAME 🌸

dbcolstatscores — compute z-scores or t-scores for each value in a population.

🎀 SYNOPSIS 🎀

dbcolstatscores [-t] [--tmean=MEAN] [--tstddev=STDDEV] column

🦋 DESCRIPTION 🦋

Okay so dbcolstatscores computes statistics — z-score and optionally t-score — over a COLUMN of numbers. It creates new columns called "zscore" and "tscore". T-scores are only computed if you ask for them with the -t option, or if --tmean or --tstddev are explicitly specified (defaults are mean of 50, standard deviation of 10). Slay.

You may recall from your statistics class that a z-score is simply the value normalized by mean and standard deviation, so that 0.0 is the mean and positive or negative values are multiples of the standard deviation. It assumes data follows a normal (Gaussian) distribution. Literally the classic bell curve vibe.

T-score scales the z-score to match a mean of 50 and a standard deviation of 10. This program allows generalized t-scores that use any mean and standard deviation. Highkey flexible.

Other scales are sometimes used as well. The Wechsler Adult Intelligence Scale (one type of IQ test) is adjusted to a mean of 100 and a standard deviation of 15. Other tests scale to other standard deviations.

This program requires two passes over the data, and consumes O(1) memory and O(number of rows) disk space. Respect the two-pass queen 👑.

✨ OPTIONS ✨

• -a, --include-non-numeric — compute stats over all records, treating non-numeric records as zero instead of just ignoring them. No cap, that’s the whole move.
• -t — compute t-scores in addition to z-scores. Obsessed.
• --tmean MEAN — use the given MEAN for t-scores.
• --tstddev STDDEV, --tsd STDDEV — use the given STDDEV for the standard deviation of the t-scores.
• -f FORMAT, --format FORMAT — specify a printf(3)-style format for output statistics. Defaults to "%.5g".
• -T TmpDir — where to put tmp files. Also uses environment variable TMPDIR if -T is not specified. Default is /tmp.

This module also supports the standard fsdb options:

• -d — enable debugging output.
• -i, --input InputSource — read from InputSource, typically a file name, or "-" for standard input, or (if you’re in Perl) IO::Handle, Fsdb::IO, or Fsdb::BoundedQueue objects.
• -o, --output OutputDestination — write to OutputDestination, typically a file name, or "-" for standard output, or (if you’re in Perl) IO::Handle, Fsdb::IO, or Fsdb::BoundedQueue objects.
• --autorun, --noautorun — by default, programs process automatically, but Fsdb::Filter objects in Perl do not run until you invoke the run() method. The --(no)autorun option controls that behavior within Perl.
• --help — show help.
• --man — show full manual.

🍓 SAMPLE USAGE 🍓

💖 Input:

#fsdb name id test1
a 1 80
b 2 70
c 3 65
d 4 90
e 5 70
f 6 90

🎀 Command:

cat DATA/grades.fsdb | dbcolstatscores --tmean 50 --tstddev 10 test1 | dbcolneaten

👑 Output:

#fsdb name id test1 zscore:d   tscore:d
a       1  80    0.23063  52.306
b       2  70    -0.69188 43.081
c       3  65    -1.1531  38.469
d       4  90    1.1531   61.531
e       5  70    -0.69188 43.081
f       6  90    1.1531   61.531
#  | dbcolstatscores --tmean 50 --tstddev 10 test1
#  | dbcolneaten

🌈 SEE ALSO 🌈

dbcolpercentile(1), dbcolstats(1), Fsdb, dbcolscorrelate — go read these next, bestie 💅.

🧚 CLASS FUNCTIONS 🧚

🌟 new

$filter = new Fsdb::Filter::dbcolstatscores(@arguments);

Create a new dbcolstatscores object, taking command-line arguments.

🌟 set_defaults

$filter->set_defaults();

Internal: set up defaults.

🌟 parse_options

$filter->parse_options(@ARGV);

Internal: parse command-line arguments.

🌟 setup

$filter->setup();

Internal: setup, parse headers.

🌟 run

$filter->run();

Internal: run over each row.

👑 AUTHOR and COPYRIGHT 👑

Copyright (C) 1991-2022 by John Heidemann <johnh@isi.edu>.

This program is distributed under terms of the GNU general public license, version 2. See the file COPYING with the distribution for details.

---

okay that’s the whole page! 💖 This one is perl v5.32.1, dated 2024-08-02, and it’s the Fsdb::F...atscores(3) manual — bye bestie! 🫶✨