VW(1)

๐Ÿ“ฆ
version 8.6.1.dfsg1 ยท 2 versions
, in ubuntu jammy, ubuntu noble

๐Ÿ’… VW(1) โ€” Vowpal Wabbit ๐Ÿ’…

okay bestie, this is the User Commands manual for vw, aka Vowpal Wabbit โ€” the fast online learning tool. This is part 1 of 3, so don't panic, we're just getting started. I'm gonna walk you through every single flag like we're ranking them in a tier list. No skips, no cap. โœจ


๐Ÿ“› NAME ๐Ÿ“›

vw - Vowpal Wabbit -- fast online learning tool

โœจ DESCRIPTION โœจ

๐Ÿ’– VW options ๐Ÿ’–

  • --ring_size arg โ€” sets the size of the example ring ๐Ÿ’
  • --onethread โ€” turns off the parse thread ๐Ÿงต

๐Ÿ”„ Update options ๐Ÿ”„

  • -l, --learning_rate arg โ€” sets the learning rate ๐Ÿ“ˆ
  • --power_t arg โ€” the t power value โšก
  • --decay_learning_rate arg โ€” sets the decay factor for learning_rate between passes ๐Ÿ“‰
  • --initial_t arg โ€” the initial t value ๐ŸŒ€
  • --feature_mask arg โ€” uses an existing regressor to decide which parameters can be updated. If no initial_regressor is given, it's also used for initial weights. ๐ŸŽญ

โš–๏ธ Weight options โš–๏ธ

  • -i, --initial_regressor arg โ€” initial regressor(s) ๐Ÿง 
  • --initial_weight arg โ€” sets every weight to an initial value of arg. โš–๏ธ
  • --random_weights arg โ€” makes initial weights random ๐ŸŽฒ
  • --normal_weights arg โ€” makes initial weights normal ๐Ÿ””
  • --truncated_normal_weights arg โ€” makes initial weights truncated normal โœ‚๏ธ
  • --sparse_weights โ€” uses a sparse datastructure for weights ๐Ÿ•ธ๏ธ
  • --input_feature_regularizer arg โ€” per feature regularization input file ๐Ÿ“‚

๐Ÿงต Parallelization options ๐Ÿงต

  • --span_server arg โ€” location of the server for setting up a spanning tree ๐ŸŒณ
  • --threads โ€” enable multi-threading ๐Ÿงต
  • --unique_id arg (=0) โ€” unique id used for cluster parallel jobs ๐Ÿ†”
  • --total arg (=1) โ€” total number of nodes used in cluster parallel job ๐Ÿ”ข
  • --node arg (=0) โ€” node number in cluster parallel job ๐Ÿ“

๐Ÿฉบ Diagnostic options ๐Ÿฉบ

  • --version โ€” version information ๐Ÿ“ฆ
  • -a, --audit โ€” print weights of features ๐Ÿ”
  • -P, --progress arg โ€” progress update frequency. int: additive, float: multiplicative ๐Ÿ“Š
  • --quiet โ€” don't output disgnostics and progress updates ๐Ÿคซ
  • -h, --help โ€” look here: http://hunch.net/~vw/ and click on Tutorial. ๐Ÿ†˜

๐ŸŽฒ Random Seed option ๐ŸŽฒ

  • --random_seed arg โ€” seed random number generator ๐ŸŽฒ

๐Ÿงฌ Feature options ๐Ÿงฌ

  • --hash arg โ€” how to hash the features. Available options: strings, all #๏ธโƒฃ
  • --hash_seed arg (=0) โ€” seed for hash function ๐ŸŒฑ
  • --ignore arg โ€” ignore namespaces beginning with character <arg> ๐Ÿšซ
  • --ignore_linear arg โ€” ignore namespaces beginning with character <arg> for linear terms only ๐Ÿ“
  • --keep arg โ€” keep namespaces beginning with character <arg> โœ…
  • --redefine arg โ€” redefine namespaces beginning with characters of string S as namespace N. <arg> shall be in form 'N:=S' where := is operator. Empty N or S are treated as default namespace. Use ':' as a wildcard in S. ๐Ÿ”„
  • -b, --bit_precision arg โ€” number of bits in the feature table ๐Ÿ”ข
  • --noconstant โ€” don't add a constant feature ๐Ÿšซ
  • -C, --constant arg โ€” set initial value of constant ๐Ÿ”ข
  • --ngram arg โ€” generate N grams. To generate N grams for a single namespace 'foo', arg should be fN. ๐Ÿ”ค
  • --skips arg โ€” generate skips in N grams. This in conjunction with the ngram tag can be used to generate generalized n-skip-k-gram. To generate n-skips for a single namespace 'foo', arg should be fN. โญ๏ธ
  • --feature_limit arg โ€” limit to N features. To apply to a single namespace 'foo', arg should be fN ๐Ÿ”ข
  • --affix arg โ€” generate prefixes/suffixes of features; argument '+2a,-3b,+1' means generate 2-char prefixes for namespace a, 3-char suffixes for b and 1 char prefixes for default namespace ๐Ÿ”—
  • --spelling arg โ€” compute spelling features for a give namespace (use '_' for default namespace) ๐Ÿ”ค
  • --dictionary arg โ€” read a dictionary for additional features (arg either 'x:file' or just 'file') ๐Ÿ“–
  • --dictionary_path arg โ€” look in this directory for dictionaries; defaults to current directory or env{PATH} ๐Ÿ“‚
  • --interactions arg โ€” create feature interactions of any level between namespaces. ๐Ÿ”€
  • --permutations โ€” use permutations instead of combinations for feature interactions of same namespace. ๐Ÿ”„
  • --leave_duplicate_interactions โ€” don't remove interactions with duplicate combinations of namespaces. For ex. this is a duplicate: '-q ab -q ba' and a lot more in '-q ::'. ๐Ÿšซ
  • -q, --quadratic arg โ€” create and use quadratic features ๐ŸŸฆ
  • --q: arg โ€” : corresponds to a wildcard for all printable characters ๐Ÿƒ
  • --cubic arg โ€” create and use cubic features ๐ŸŸช

๐Ÿงช Example options ๐Ÿงช

  • -t, --testonly โ€” ignore label information and just test ๐Ÿงช
  • --holdout_off โ€” no holdout data in multiple passes ๐Ÿšซ
  • --holdout_period arg (=10) โ€” holdout period for test only โณ
  • --holdout_after arg โ€” holdout after n training examples, default off (disables holdout_period) โธ๏ธ
  • --early_terminate arg (=3) โ€” specify the number of passes tolerated when holdout loss doesn't decrease before early termination ๐Ÿ›‘
  • --passes arg โ€” number of training passes ๐Ÿ”
  • --initial_pass_length arg โ€” initial number of examples per pass ๐Ÿ“
  • --examples arg โ€” number of examples to parse ๐Ÿ”ข
  • --min_prediction arg โ€” smallest prediction to output ๐Ÿ”ฝ
  • --max_prediction arg โ€” largest prediction to output ๐Ÿ”ผ
  • --sort_features โ€” turn this on to disregard order in which features have been defined. This will lead to smaller cache sizes ๐Ÿ—‚๏ธ
  • --loss_function arg (=squared) โ€” specify the loss function to be used, uses squared by default. Currently available ones are squared, classic, hinge, logistic, quantile and poisson. ๐Ÿ“‰
  • --quantile_tau arg (=0.5) โ€” parameter \tau associated with Quantile loss. Defaults to 0.5 ๐Ÿ“Š
  • --l1 arg โ€” l_1 lambda ๐Ÿงฎ
  • --l2 arg โ€” l_2 lambda ๐Ÿงฎ
  • --no_bias_regularization arg โ€” no bias in regularization ๐Ÿšซ
  • --named_labels arg โ€” use names for labels (multiclass, etc.) rather than integers, argument specified all possible labels, comma-sep, eg "--named_labels Noun,Verb,Adj,Punc" ๐Ÿท๏ธ

๐Ÿ’พ Output model ๐Ÿ’พ

  • -f, --final_regressor arg โ€” final regressor ๐Ÿ
  • --readable_model arg โ€” output human-readable final regressor with numeric features ๐Ÿ“„
  • --invert_hash arg โ€” output human-readable final regressor with feature names. Computationally expensive. ๐Ÿ’ธ
  • --save_resume โ€” save extra state so learning can be resumed later with new data ๐Ÿ’พ
  • --preserve_performance_counters โ€” reset performance counters when warmstarting ๐Ÿ”„
  • --save_per_pass โ€” save the model after every pass over data ๐Ÿ’พ
  • --output_feature_regularizer_binary arg โ€” per feature regularization output file ๐Ÿ“ฆ
  • --output_feature_regularizer_text arg โ€” per feature regularization output file, in text ๐Ÿ“„
  • --id arg โ€” user supplied ID embedded into the final regressor ๐Ÿ†”

๐Ÿ“ค Output options ๐Ÿ“ค

  • -p, --predictions arg โ€” file to output predictions to ๐Ÿ“ค
  • -r, --raw_predictions arg โ€” file to output unnormalized predictions to ๐Ÿ“ค

๐Ÿ” Audit Regressor ๐Ÿ”

  • --audit_regressor arg โ€” stores feature names and their regressor values. Same dataset must be used for both regressor training and this mode. ๐Ÿ”

๐ŸŽฏ Search options ๐ŸŽฏ

  • --search arg โ€” use learning to search, argument=maximum action id or 0 for LDF ๐Ÿ”Ž
  • --search_task arg โ€” the search task (use "--search_task list" to get a list of available tasks) ๐Ÿ“‹
  • --search_metatask arg โ€” the search metatask (use "--search_metatask list" to get a list of available metatasks) ๐Ÿ“‹
  • --search_interpolation arg โ€” at what level should interpolation happen? [*data|policy] ๐ŸŽš๏ธ
  • --search_rollout arg โ€” how should rollouts be executed? [policy|oracle|*mix_per_state|mix_per_roll|none] ๐ŸŽฌ
  • --search_rollin arg โ€” how should past trajectories be generated? [policy|oracle|*mix_per_state|mix_per_roll] ๐ŸŽž๏ธ
  • --search_passes_per_policy arg (=1) โ€” number of passes per policy (only valid for search_interpolation=policy) ๐Ÿ”
  • --search_beta arg (=0.5) โ€” interpolation rate for policies (only valid for search_interpolation=policy) ๐ŸŽš๏ธ
  • --search_alpha arg (=1.00000001e-10) โ€” annealed beta = 1-(1-alpha)^t (only valid for search_interpolation=data) ๐Ÿ“‰
  • --search_total_nb_policies arg โ€” if we are going to train the policies through multiple separate calls to vw, we need to specify this parameter and tell vw how many policies are eventually going to be trained ๐Ÿ”ข
  • --search_trained_nb_policies arg โ€” the number of trained policies in a file ๐Ÿ“
  • --search_allowed_transitions arg โ€” read file of allowed transitions [def: all transitions are allowed] ๐Ÿ“œ
  • --search_subsample_time arg โ€” instead of training at all timesteps, use a subset. if value in (0,1), train on a random v%. if v>=1, train on precisely v steps per example, if v<=-1, use active learning โฑ๏ธ
  • --search_neighbor_features arg โ€” copy features from neighboring lines. argument looks like: '-1:a,+2' meaning copy previous line namespace a and next next line from namespace _unnamed_, where ',' separates them ๐Ÿ”—
  • --search_rollout_num_steps arg โ€” how many calls of "loss" before we stop really predicting on rollouts and switch to oracle (default means "infinite") ๐Ÿ”„
  • --search_history_length arg (=1) โ€” some tasks allow you to specify how much history their depend on; specify that here ๐Ÿ“œ
  • --search_no_caching โ€” turn off the built-in caching ability (makes things slower, but technically more safe) ๐Ÿšซ
  • --search_xv โ€” train two separate policies, alternating prediction/learning ๐Ÿ”€
  • --search_perturb_oracle arg (=0) โ€” perturb the oracle on rollin with this probability ๐ŸŽฒ
  • --search_linear_ordering โ€” insist on generating examples in linear order (def: hoopla permutation) ๐Ÿ“
  • --search_active_verify arg โ€” verify that active learning is doing the right thing (arg = multiplier, should be = cost_range * range_c) โœ…
  • --search_save_every_k_runs arg โ€” save model every k runs ๐Ÿ’พ

๐Ÿ” Experience Replay ๐Ÿ”

  • --replay_c arg โ€” use experience replay at a specified level [b=classification/regression, m=multiclass, c=cost sensitive] with specified buffer size ๐Ÿ”
  • --replay_c_count arg (=1) โ€” how many times (in expectation) should each example be played (default: 1 = permuting) ๐Ÿ”ข

๐Ÿงช Explore evaluation ๐Ÿงช

  • --explore_eval โ€” Evaluate explore_eval adf policies ๐Ÿงช
  • --multiplier arg โ€” Multiplier used to make all rejection sample probabilities <= 1. no cap, it just scales everything so those probs stay in check ๐Ÿ’…

๐ŸŽ€ Make Multiclass into Contextual Bandit ๐ŸŽ€

  • --cbify arg โ€” Convert multiclass on <k> classes into a contextual bandit problem. it's giving glow-up โœจ
  • --cbify_cs โ€” consume cost-sensitive classification examples instead of multiclass. lowkey a whole different vibe ๐Ÿฆ‹
  • --loss0 arg (=0) โ€” loss for correct label. bestie, you want this low ๐Ÿ’–
  • --loss1 arg (=1) โ€” loss for incorrect label. not the vibe, but we move ๐Ÿ˜ญ

๐Ÿฆ‹ Contextual Bandit Exploration with Action Dependent Features ๐Ÿฆ‹

  • --cb_explore_adf โ€” Online explore-exploit for a contextual bandit problem with multiline action dependent features. main character energy fr fr ๐Ÿ‘‘
  • --first arg โ€” tau-first exploration. firsties! ๐Ÿ™ˆ
  • --epsilon arg โ€” epsilon-greedy exploration. the classic, iconic ๐Ÿ’…
  • --bag arg โ€” bagging-based exploration. bag it up ๐ŸŽ€
  • --cover arg โ€” Online cover based exploration. cover me in glory โœจ
  • --psi arg (=1) โ€” disagreement parameter for cover. it's giving disagreement, but make it fashion ๐ŸŒธ
  • --nounif โ€” do not explore uniformly on zero-probability actions in cover. no uniform exploration for you ๐Ÿšซ
  • --softmax โ€” softmax exploration. soft like a cloud โ˜๏ธ
  • --regcb โ€” RegCB-elim exploration. elimination style, periodt ๐Ÿ’€
  • --regcbopt โ€” RegCB optimistic exploration. optimistic queen ๐Ÿ‘‘
  • --mellowness arg (=0.100000001) โ€” RegCB mellowness parameter c_0. Default 0.1. stay mellow, bestie ๐Ÿง˜
  • --greedify โ€” always update first policy once in bagging. greedy but make it cute ๐Ÿ’–
  • --cb_min_cost arg (=0) โ€” lower bound on cost. keep it low, low, low ๐ŸŽถ
  • --cb_max_cost arg (=1) โ€” upper bound on cost. cap it at 1, no cap ๐Ÿงข
  • --first_only โ€” Only explore the first action in a tie-breaking event. first is the worst, second is the best? not here, first only ๐Ÿฅ‡
  • --lambda arg (=-1) โ€” parameter for softmax. lambda, slay ๐Ÿ’…

๐ŸŒˆ Contextual Bandit Exploration ๐ŸŒˆ

  • --cb_explore arg โ€” Online explore-exploit for a <k> action contextual bandit problem. explore and exploit, the ultimate duo ๐Ÿฆ‹
  • --first arg โ€” tau-first exploration. tau-riffic! โœจ
  • --epsilon arg (=0.0500000007) โ€” epsilon-greedy exploration. a lil epsilon, a lot of drama ๐Ÿ’…
  • --bag arg โ€” bagging-based exploration. bag secured ๐Ÿ‘œ
  • --cover arg โ€” Online cover based exploration. cover girl, put the bass in your walk ๐ŸŽถ
  • --psi arg (=1) โ€” disagreement parameter for cover. we disagree, respectfully ๐Ÿ™…

๐ŸŒธ Multiworld Testing Options ๐ŸŒธ

  • --multiworld_test arg โ€” Evaluate features as a policies. test it like it's hot ๐Ÿ”ฅ
  • --learn arg โ€” Do Contextual Bandit learning on <n> classes. learn, queen, learn ๐Ÿ‘‘
  • --exclude_eval โ€” Discard mwt policy features before learning. throw it away, it's not for you ๐Ÿ—‘๏ธ

๐Ÿ’… Contextual Bandit with Action Dependent Features ๐Ÿ’…

  • --cb_adf โ€” Do Contextual Bandit learning with multiline action dependent features. adf stands for absolutely dazzling features โœจ
  • --rank_all โ€” Return actions sorted by score order. ranking, we love to see it ๐Ÿ“Š
  • --no_predict โ€” Do not do a prediction when training. no predictions, just vibes ๐Ÿšซ
  • --cb_type arg (=ips) โ€” contextual bandit method to use in {ips,dm,dr, mtr}. pick your fighter: ips, dm, dr, or mtr ๐ŸฅŠ

๐Ÿ‘‘ Contextual Bandit Options ๐Ÿ‘‘

  • --cb arg โ€” Use contextual bandit learning with <k> costs. contextual bandit, but make it costs ๐Ÿ’ธ
  • --cb_type arg (=dr) โ€” contextual bandit method to use in {ips,dm,dr}. the holy trinity: ips, dm, dr ๐Ÿ™
  • --eval โ€” Evaluate a policy rather than optimizing. just evaluate, don't optimize, periodt ๐Ÿ’…

๐ŸŽ€ Cost Sensitive One Against All with Label Dependent Features ๐ŸŽ€

  • --csoaa_ldf arg โ€” Use one-against-all multiclass learning with label dependent features. one against all, the ultimate showdown โš”๏ธ
  • --ldf_override arg โ€” Override singleline or multiline from csoaa_ldf or wap_ldf, eg if stored in file. override it like a boss ๐Ÿ‘‘
  • --csoaa_rank โ€” Return actions sorted by score order. rank it up ๐ŸŽถ
  • --probabilities โ€” predict probabilites of all classes. probability? more like proba-BILL-ity ๐Ÿ’…
  • --wap_ldf arg โ€” Use weighted all-pairs multiclass learning with label dependent features. Specify singleline or multiline. weighted all-pairs, serving looks ๐Ÿ’ƒ

โœจ Interact via elementwise multiplication โœจ

  • --interact arg โ€” Put weights on feature products from namespaces <n1> and <n2>. interact, don't just sit there ๐Ÿ’ฌ

๐Ÿ’– Cost Sensitive One Against All ๐Ÿ’–

  • --csoaa arg โ€” One-against-all multiclass with <k> costs. one against all, but make it cost-sensitive ๐Ÿ’ธ

๐Ÿฆ‹ Cost-sensitive Active Learning ๐Ÿฆ‹

  • --cs_active arg โ€” Cost-sensitive active learning with <k> costs. active learning, but cost-conscious ๐Ÿ’…
  • --simulation โ€” cost-sensitive active learning simulation mode. just a simulation, bestie ๐ŸŽฎ
  • --baseline โ€” cost-sensitive active learning baseline. baseline, the foundation of it all ๐Ÿ—๏ธ
  • --domination โ€” cost-sensitive active learning use domination. Default 1. dominate the game ๐Ÿ‘‘
  • --mellowness arg (=0.100000001) โ€” mellowness parameter c_0. Default 0.1. stay mellow, stay c_0 ๐ŸŒŠ
  • --range_c arg (=0.5) โ€” parameter controlling the threshold for per-label cost uncertainty. Default 0.5. range_c, controlling the uncertainty ๐ŸŽ›๏ธ
  • --max_labels arg (=18446744073709551615) โ€” maximum number of label queries. max labels, the limit does not exist ๐Ÿš€
  • --min_labels arg (=18446744073709551615) โ€” minimum number of label queries. min labels, also huge, iykyk ๐Ÿคฏ
  • --cost_max arg (=1) โ€” cost upper bound. Default 1. cost max, cap it ๐Ÿงข
  • --cost_min arg (=0) โ€” cost lower bound. Default 0. cost min, floor it ๐Ÿš—
  • --csa_debug โ€” print debug stuff for cs_active. debug, debug, debug ๐Ÿ›

๐ŸŒˆ Multilabel One Against All ๐ŸŒˆ

  • --multilabel_oaa arg โ€” One-against-all multilabel with <k> labels. multilabel, multi-slay ๐Ÿ’…

๐ŸŒธ importance weight classes ๐ŸŒธ

  • --classweight arg โ€” importance weight multiplier for class. weight it up, make it important ๐Ÿ’ช

๐Ÿ’… Recall Tree ๐Ÿ’…

  • --recall_tree arg โ€” Use online tree for multiclass. tree time, bestie ๐ŸŒณ
  • --max_candidates arg โ€” maximum number of labels per leaf in the tree. candidates, but make it max ๐Ÿƒ
  • --bern_hyper arg (=1) โ€” recall tree depth penalty. bern_hyper, the depth penalty we deserve ๐Ÿ’…
  • --max_depth arg โ€” maximum depth of the tree, default log_2 (#classes). depth so deep, log_2 of classes ๐Ÿคฟ
  • --node_only arg (=0) โ€” only use node features, not full path features. node only, keep it simple ๐ŸŽฏ
  • --randomized_routing arg (=0) โ€” randomized routing. randomize the route, live a little ๐Ÿ—บ๏ธ

๐Ÿ‘‘ Logarithmic Time Multiclass Tree ๐Ÿ‘‘

  • --log_multi arg โ€” Use online tree for multiclass. log time, but make it tree ๐ŸŒฒ
  • --no_progress โ€” disable progressive validation. no progress? relatable ๐Ÿ˜ญ
  • --swap_resistance arg (=4) โ€” higher = more resistance to swap, default=4. resist the swap, stay strong ๐Ÿ’ช

๐ŸŽ€ Error Correcting Tournament Options ๐ŸŽ€

  • --ect arg โ€” Error correcting tournament with <k> labels. tournament arc, but for errors ๐Ÿ†
  • --error arg (=0) โ€” errors allowed by ECT. errors allowed, we love a forgiving queen ๐Ÿ‘‘

โœจ Boosting โœจ

  • --boosting arg โ€” Online boosting with <N> weak learners. boost it, bestie ๐Ÿš€
  • --gamma arg (=0.100000001) โ€” weak learner's edge (=0.1), used only by online BBM. gamma, the edge you need ๐Ÿ”ช
  • --alg arg (=BBM) โ€” specify the boosting algorithm: BBM (default), logistic (AdaBoost.OL.W), adaptive (AdaBoost.OL). pick your algorithm: BBM, logistic, or adaptive ๐ŸŽฒ

๐Ÿ’– One Against All Options ๐Ÿ’–

  • --oaa arg โ€” One-against-all multiclass with <k> labels. oaa, the original one-against-all ๐Ÿ’…
  • --oaa_subsample arg โ€” subsample this number of negative examples when learning. subsample the negatives, we love a sample ๐ŸŽฒ
  • --probabilities โ€” predict probabilites of all classes. probabilities, but spelled with an extra i for flavor ๐Ÿ’–
  • --scores โ€” output raw scores per class. raw scores, no filter needed ๐Ÿ”ฅ

๐Ÿฆ‹ Top K ๐Ÿฆ‹

  • --top arg โ€” top k recommendation. top k, the only k that matters ๐Ÿ‘‘

๐ŸŒˆ Experience Replay ๐ŸŒˆ

  • --replay_m arg โ€” use experience replay at a specified level [b=classification/regression, m=multiclass, c=cost sensitive] with specified buffer size. replay it like you mean it ๐Ÿ”
  • --replay_m_count arg (=1) โ€” how many times (in expectation) should each example be played (default: 1 = permuting). play it again, sam ๐ŸŽต

๐ŸŒธ Binary loss ๐ŸŒธ

  • --binary โ€” report loss as binary classification on -1,1. binary loss, it's giving -1 or 1 ๐Ÿ’…

๐Ÿ’… Bootstrap ๐Ÿ’…

  • --bootstrap arg โ€” k-way bootstrap by online importance resampling. bootstrap, but make it online ๐Ÿ‘ข
  • --bs_type arg โ€” prediction type {mean,vote}. mean or vote? you decide ๐Ÿ—ณ๏ธ

๐Ÿ‘‘ scorer options ๐Ÿ‘‘

  • --link arg (=identity) โ€” Specify the link function: identity, logistic, glf1 or poisson. link up with identity, logistic, glf1, or poisson ๐Ÿ”—

๐ŸŽ€ Stagewise polynomial options ๐ŸŽ€

  • --stage_poly โ€” use stagewise polynomial feature learning. stagewise polynomial, serving features ๐Ÿ’ƒ
  • --sched_exponent arg (=1) โ€” exponent controlling quantity of included features. exponent, but make it scheduling ๐Ÿ“ˆ
  • --batch_sz arg (=1000) โ€” multiplier on batch size before including more features. batch size, multiplied by 1000, no cap ๐Ÿงข
  • --batch_sz_no_doubling โ€” batch_sz does not double. no doubling, we stay steady ๐Ÿšซ

โœจ Low Rank Quadratics FA โœจ

  • --lrqfa arg โ€” use low rank quadratic features with field aware weights. low rank, high impact ๐Ÿ’…

๐Ÿ’– Low Rank Quadratics ๐Ÿ’–

  • --lrq arg โ€” use low rank quadratic features. lrq, the low rank quadratic queen ๐Ÿ‘‘
  • --lrqdropout โ€” use dropout training for low rank quadratic features. dropout, but make it low rank ๐ŸŽ“

  • --autolink arg โ€” create link function with polynomial d. autolink, link it up automatically ๐Ÿ”—

๐ŸŒˆ Marginal ๐ŸŒˆ

  • --marginal arg โ€” substitute marginal label estimates for ids. marginal, but make it estimates ๐Ÿ’…
  • --initial_denominator arg (=1) โ€” initial denominator. denominator starts at 1, slay โž—
  • --initial_numerator arg (=0.5) โ€” initial numerator. numerator starts at 0.5, half the drama ๐ŸŽญ
  • --compete โ€” enable competition with marginal features. compete, bestie, compete ๐Ÿ
  • --update_before_learn arg (=0) โ€” update marginal values before learning. update before learn, always ahead ๐Ÿ”„
  • --unweighted_marginals arg (=0) โ€” ignore importance weights when computing marginals. ignore the weights, just the marginals ๐Ÿ’…
  • --decay arg (=0) โ€” decay multiplier per event (1e-3 for example). decay, decay, decay (like my will to live) ๐Ÿ’€

๐ŸŒธ Matrix Factorization Reduction ๐ŸŒธ

  • --new_mf arg โ€” rank for reduction-based matrix factorization. matrix factorization, but make it reduced ๐Ÿงฎ

๐Ÿ’… Neural Network ๐Ÿ’…

  • --nn arg โ€” Sigmoidal feedforward network with <k> hidden units. neural network, the main character ๐Ÿง 
  • --inpass โ€” Train or test sigmoidal feedforward network with input passthrough. input passthrough, pass it through ๐Ÿšช
  • --multitask โ€” Share hidden layer across all reduced tasks. multitask, share the layer, share the love ๐Ÿ’•
  • --dropout โ€” Train or test sigmoidal feedforward network using dropout. dropout, but for neural nets ๐ŸŽ“
  • --meanfield โ€” Train or test sigmoidal feedforward network using mean field. meanfield, the meanest field ๐ŸŒพ

๐Ÿ‘‘ Confidence ๐Ÿ‘‘

  • --confidence โ€” Get confidence for binary predictions. confidence, get you some ๐Ÿ’…
  • --confidence_after_training โ€” Confidence after training. confidence after training, the afterglow โœจ

๐ŸŽ€ Active Learning with Cover ๐ŸŽ€

  • --active_cover โ€” enable active learning with cover. active cover, cover me in learning ๐Ÿ“š
  • --mellowness arg (=8) โ€” active learning mellowness parameter c_0. Default 8. mellow to the max ๐ŸŒŠ
  • --alpha arg (=1) โ€” active learning variance upper bound parameter alpha. Default 1. alpha, the upper bound queen ๐Ÿ‘‘
  • --beta_scale arg (=3.1622777) โ€” active learning variance upper bound parameter beta_scale. Default sqrt(10). beta_scale, sqrt(10) vibes ๐Ÿงฎ
  • --cover arg (=12) โ€” cover size. Default 12. cover size 12, a dozen of slay ๐Ÿฅš
  • --oracular โ€” Use Oracular-CAL style query or not. Default false. oracular, but only if you want ๐Ÿ‘๏ธ

โœจ Active Learning โœจ

  • --active โ€” enable active learning. active learning, engage ๐Ÿš€
  • --simulation โ€” active learning simulation mode. simulation mode, pretend it's real ๐ŸŽฎ
  • --mellowness arg (=8) โ€” active learning mellowness parameter c_0. Default 8. mellow again, because why not ๐Ÿง˜

๐Ÿ’– Experience Replay ๐Ÿ’–

  • --replay_b arg โ€” use experience replay at a specified level [b=classification/regression, m=multiclass, c=cost sensitive] with specified buffer size. replay_b, the b stands for bestie ๐Ÿ’–
  • --replay_b_count arg (=1) โ€” how many times (in expectation) should each example be played (default: 1 = permuting). play it again, and again, and again ๐Ÿ”

๐Ÿฆ‹ Baseline options ๐Ÿฆ‹

  • --baseline โ€” Learn an additive baseline (from constant features) and a residual separately in regression. baseline, the foundation of your regression ๐Ÿ—๏ธ
  • --lr_multiplier arg โ€” learning rate multiplier for baseline model. learning rate, but multiplied ๐Ÿ’…
  • --global_only โ€” use separate example with only global constant for baseline predictions. global only, keep it universal ๐ŸŒ
  • --check_enabled โ€” only use baseline when the example contains enabled flag. check enabled, only if you're enabled โœ…

๐ŸŒˆ OjaNewton options ๐ŸŒˆ

  • --OjaNewton โ€” Online Newton with Oja's Sketch. OjaNewton, the sketchy Newton ๐ŸŽจ
  • --sketch_size arg (=10) โ€” size of sketch. sketch size 10, a perfect ten ๐Ÿ’…
  • --epoch_size arg (=1) โ€” size of epoch. epoch size 1, one epoch at a time ๐Ÿ•
  • --alpha arg (=1) โ€” mutiplicative constant for indentiy. alpha, mutiplicative and indentiy (typos included) ๐Ÿ’–
  • --alpha_inverse arg โ€” one over alpha, similar to learning rate. one over alpha, like a learning rate but cuter ๐Ÿฅฐ
  • --learning_rate_cnt arg (=2) โ€” constant for the learning rate 1/t. learning rate constant, 1/t, iconic ๐Ÿ’…
  • --normalize arg (=1) โ€” normalize the features or not. normalize it, or don't, you do you ๐Ÿ’
  • --random_init arg (=1) โ€” do you want Oja's initialization to be randomized or not? defaults to 1 (so yes, randomizing ๐Ÿ’ซ).

๐ŸŒˆ LBFGS and Conjugate Gradient options:

  • --conjugate_gradient โ€” roll with conjugate-gradient-based optimization.
  • --bfgs โ€” roll with bfgs optimization instead.
  • --hessian_on โ€” actually use the second derivative in the line search, bestie.
  • --mem arg (=15) โ€” memory in bfgs, default 15.
  • --termination arg (=0.00100000005) โ€” the termination threshold. that's the exact default, no rounding, we don't do that here.

๐Ÿงš Latent Dirichlet Allocation:

  • --lda arg โ€” run lda with &lt;int&gt; topics.
  • --lda_alpha arg (=0.100000001) โ€” prior on the sparsity of per-document topic weights, default 0.100000001.
  • --lda_rho arg (=0.100000001) โ€” prior on the sparsity of topic distributions, default 0.100000001.
  • --lda_D arg (=10000) โ€” number of documents, default 10000.
  • --lda_epsilon arg (=0.00100000005) โ€” loop convergence threshold, default 0.00100000005.
  • --minibatch arg (=1) โ€” minibatch size, for LDA. default 1.
  • --math-mode arg (=0) โ€” math mode: simd, accuracy, fast-approx. default 0.
  • --metrics arg (=0) โ€” compute metrics. default 0.

๐ŸŽ€ Noop Learner:

  • --noop โ€” do no learning. that's it. that's the whole vibe. do nothing, slay โœจ
okay the original really does spell it psuedolearner and i am not about to fix the source's spelling, i'm just the messenger ๐Ÿ’€
  • --print โ€” print examples.

๐Ÿ‘‘ Gradient Descent Matrix Factorization:

  • --rank arg โ€” rank for matrix factorization.

๐ŸŒธ Network sending:

  • --sendto arg โ€” send examples to &lt;host&gt;.

๐Ÿฆ‹ Stochastic Variance Reduced Gradient:

  • --svrg โ€” Streaming Stochastic Variance Reduced Gradient.
  • --stage_size arg (=1) โ€” number of passes per SVRG stage, default 1.

๐Ÿ”ฅ Follow the Regularized Leader:

  • --ftrl โ€” FTRL: Follow the Proximal Regularized Leader.
  • --ftrl_alpha arg (=0.00499999989) โ€” learning rate for FTRL optimization, default 0.00499999989.
  • --ftrl_beta arg (=0.100000001) โ€” FTRL beta parameter, default 0.100000001.
  • --pistol โ€” FTRL: Parameter-free Stochastic Learning.
  • --ftrl_alpha arg (=1) โ€” learning rate for FTRL optimization, default 1.
  • --ftrl_beta arg (=0.5) โ€” FTRL beta parameter, default 0.5.
not me noticing --ftrl_alpha and --ftrl_beta show up twice in this list with completely different defaults ๐Ÿ™ˆ i'm reporting exactly what the page says, both entries, both defaults, no merging, no editing, periodt.

โญ Kernel SVM:

  • --ksvm โ€” kernel svm.
  • --reprocess arg (=1) โ€” number of reprocess steps for LASVM, default 1.
  • --pool_greedy โ€” use greedy selection on mini pools.
  • --para_active โ€” do parallel active learning.
  • --pool_size arg (=1) โ€” size of pools for active learning, default 1.
  • --subsample arg (=1) โ€” number of items to subsample from the pool, default 1.
  • --kernel arg (=linear) โ€” type of kernel (rbf or linear (default)).
  • --bandwidth arg (=1) โ€” bandwidth of rbf kernel, default 1.
  • --degree arg (=2) โ€” degree of poly kernel, default 2.
  • --lambda arg โ€” saving regularization for test time.

๐Ÿ’– Gradient Descent options:

  • --sgd โ€” use regular stochastic gradient descent update.
  • --adaptive โ€” use adaptive, individual learning rates.
  • --adax โ€” use adaptive learning rates with x^2 instead of g^2x^2.
  • --invariant โ€” use safe/importance aware updates.
  • --normalized โ€” use per feature normalized updates.
  • --sparse_l2 arg (=0) โ€” use per feature normalized updates. default 0.
  • --l1_state arg (=0) โ€” use per feature normalized updates. default 0.
  • --l2_state arg (=1) โ€” use per feature normalized updates. default 1.
yep, the last four all say "use per feature normalized updates" in the original. i'm not the one who wrote that, i'm just the one who's telling you ๐Ÿ˜ญ verbatim, bestie.

๐ŸŒˆ Input options:

  • -d [ --data ] arg โ€” Example Set.
  • --daemon โ€” persistent daemon mode on port 26542.
  • --foreground โ€” in persistent daemon mode, do not run in the background.
  • --port arg โ€” port to listen on; use 0 to pick an unused port.
  • --num_children arg โ€” number of children for persistent daemon mode.
  • --pid_file arg โ€” write pid file in persistent daemon mode.
  • --port_file arg โ€” write port used in persistent daemon mode.
  • -c [ --cache ] โ€” use a cache. the default is <data>.cache.
  • --cache_file arg โ€” the location(s) of cache_file.
  • --json โ€” enable JSON parsing.
  • --dsjson โ€” enable Decision Service JSON parsing.
  • -k [ --kill_cache ] โ€” do not reuse an existing cache: create a new one always.
  • --compressed โ€” use gzip format whenever possible. if a cache file is being created, this option creates a compressed cache file. a mixture of raw-text & compressed inputs are supported with autodetection.
  • --no_stdin โ€” do not default to reading from stdin.

and that's the whole page, bestie, you made it to the end ๐Ÿซถ this is from vw 8.6.1, dated December 2020, and it's the VW(1) manual. go forth and train something iconic ๐Ÿ’…โœจ

๐Ÿ“ฆ where this page comes from