VW(1)
๐ VW(1) โ Vowpal Wabbit ๐
okay bestie, this is the User Commands manual for vw, aka Vowpal Wabbit โ the fast online learning tool. This is part 1 of 3, so don't panic, we're just getting started. I'm gonna walk you through every single flag like we're ranking them in a tier list. No skips, no cap. โจ
๐ NAME ๐
vw - Vowpal Wabbit -- fast online learning tool
โจ DESCRIPTION โจ
๐ VW options ๐
--ring_sizearg โ sets the size of the example ring ๐--onethreadโ turns off the parse thread ๐งต
๐ Update options ๐
-l,--learning_ratearg โ sets the learning rate ๐--power_targ โ the t power value โก--decay_learning_ratearg โ sets the decay factor for learning_rate between passes ๐--initial_targ โ the initial t value ๐--feature_maskarg โ uses an existing regressor to decide which parameters can be updated. If no initial_regressor is given, it's also used for initial weights. ๐ญ
โ๏ธ Weight options โ๏ธ
-i,--initial_regressorarg โ initial regressor(s) ๐ง--initial_weightarg โ sets every weight to an initial value of arg. โ๏ธ--random_weightsarg โ makes initial weights random ๐ฒ--normal_weightsarg โ makes initial weights normal ๐--truncated_normal_weightsarg โ makes initial weights truncated normal โ๏ธ--sparse_weightsโ uses a sparse datastructure for weights ๐ธ๏ธ--input_feature_regularizerarg โ per feature regularization input file ๐
๐งต Parallelization options ๐งต
--span_serverarg โ location of the server for setting up a spanning tree ๐ณ--threadsโ enable multi-threading ๐งต--unique_idarg (=0) โ unique id used for cluster parallel jobs ๐--totalarg (=1) โ total number of nodes used in cluster parallel job ๐ข--nodearg (=0) โ node number in cluster parallel job ๐
๐ฉบ Diagnostic options ๐ฉบ
--versionโ version information ๐ฆ-a,--auditโ print weights of features ๐-P,--progressarg โ progress update frequency. int: additive, float: multiplicative ๐--quietโ don't output disgnostics and progress updates ๐คซ-h,--helpโ look here: http://hunch.net/~vw/ and click on Tutorial. ๐
๐ฒ Random Seed option ๐ฒ
--random_seedarg โ seed random number generator ๐ฒ
๐งฌ Feature options ๐งฌ
--hasharg โ how to hash the features. Available options: strings, all #๏ธโฃ--hash_seedarg (=0) โ seed for hash function ๐ฑ--ignorearg โ ignore namespaces beginning with character <arg> ๐ซ--ignore_lineararg โ ignore namespaces beginning with character <arg> for linear terms only ๐--keeparg โ keep namespaces beginning with character <arg> โ--redefinearg โ redefine namespaces beginning with characters of string S as namespace N. <arg> shall be in form'N:=S'where:=is operator. Empty N or S are treated as default namespace. Use':'as a wildcard in S. ๐-b,--bit_precisionarg โ number of bits in the feature table ๐ข--noconstantโ don't add a constant feature ๐ซ-C,--constantarg โ set initial value of constant ๐ข--ngramarg โ generate N grams. To generate N grams for a single namespace'foo', arg should befN. ๐ค--skipsarg โ generate skips in N grams. This in conjunction with the ngram tag can be used to generate generalized n-skip-k-gram. To generate n-skips for a single namespace'foo', arg should befN. โญ๏ธ--feature_limitarg โ limit to N features. To apply to a single namespace'foo', arg should befN๐ข--affixarg โ generate prefixes/suffixes of features; argument'+2a,-3b,+1'means generate 2-char prefixes for namespace a, 3-char suffixes for b and 1 char prefixes for default namespace ๐--spellingarg โ compute spelling features for a give namespace (use'_'for default namespace) ๐ค--dictionaryarg โ read a dictionary for additional features (arg either'x:file'or just'file') ๐--dictionary_patharg โ look in this directory for dictionaries; defaults to current directory orenv{PATH}๐--interactionsarg โ create feature interactions of any level between namespaces. ๐--permutationsโ use permutations instead of combinations for feature interactions of same namespace. ๐--leave_duplicate_interactionsโ don't remove interactions with duplicate combinations of namespaces. For ex. this is a duplicate:'-q ab -q ba'and a lot more in'-q ::'. ๐ซ-q,--quadraticarg โ create and use quadratic features ๐ฆ--q:arg โ:corresponds to a wildcard for all printable characters ๐--cubicarg โ create and use cubic features ๐ช
๐งช Example options ๐งช
-t,--testonlyโ ignore label information and just test ๐งช--holdout_offโ no holdout data in multiple passes ๐ซ--holdout_periodarg (=10) โ holdout period for test only โณ--holdout_afterarg โ holdout after n training examples, default off (disables holdout_period) โธ๏ธ--early_terminatearg (=3) โ specify the number of passes tolerated when holdout loss doesn't decrease before early termination ๐--passesarg โ number of training passes ๐--initial_pass_lengtharg โ initial number of examples per pass ๐--examplesarg โ number of examples to parse ๐ข--min_predictionarg โ smallest prediction to output ๐ฝ--max_predictionarg โ largest prediction to output ๐ผ--sort_featuresโ turn this on to disregard order in which features have been defined. This will lead to smaller cache sizes ๐๏ธ--loss_functionarg (=squared) โ specify the loss function to be used, uses squared by default. Currently available ones are squared, classic, hinge, logistic, quantile and poisson. ๐--quantile_tauarg (=0.5) โ parameter\tauassociated with Quantile loss. Defaults to 0.5 ๐--l1arg โ l_1 lambda ๐งฎ--l2arg โ l_2 lambda ๐งฎ--no_bias_regularizationarg โ no bias in regularization ๐ซ--named_labelsarg โ use names for labels (multiclass, etc.) rather than integers, argument specified all possible labels, comma-sep, eg"--named_labels Noun,Verb,Adj,Punc"๐ท๏ธ
๐พ Output model ๐พ
-f,--final_regressorarg โ final regressor ๐--readable_modelarg โ output human-readable final regressor with numeric features ๐--invert_hasharg โ output human-readable final regressor with feature names. Computationally expensive. ๐ธ--save_resumeโ save extra state so learning can be resumed later with new data ๐พ--preserve_performance_countersโ reset performance counters when warmstarting ๐--save_per_passโ save the model after every pass over data ๐พ--output_feature_regularizer_binaryarg โ per feature regularization output file ๐ฆ--output_feature_regularizer_textarg โ per feature regularization output file, in text ๐--idarg โ user supplied ID embedded into the final regressor ๐
๐ค Output options ๐ค
-p,--predictionsarg โ file to output predictions to ๐ค-r,--raw_predictionsarg โ file to output unnormalized predictions to ๐ค
๐ Audit Regressor ๐
--audit_regressorarg โ stores feature names and their regressor values. Same dataset must be used for both regressor training and this mode. ๐
๐ฏ Search options ๐ฏ
--searcharg โ use learning to search, argument=maximum action id or 0 for LDF ๐--search_taskarg โ the search task (use"--search_task list"to get a list of available tasks) ๐--search_metataskarg โ the search metatask (use"--search_metatask list"to get a list of available metatasks) ๐--search_interpolationarg โ at what level should interpolation happen?[*data|policy]๐๏ธ--search_rolloutarg โ how should rollouts be executed?[policy|oracle|*mix_per_state|mix_per_roll|none]๐ฌ--search_rollinarg โ how should past trajectories be generated?[policy|oracle|*mix_per_state|mix_per_roll]๐๏ธ--search_passes_per_policyarg (=1) โ number of passes per policy (only valid for search_interpolation=policy) ๐--search_betaarg (=0.5) โ interpolation rate for policies (only valid for search_interpolation=policy) ๐๏ธ--search_alphaarg (=1.00000001e-10) โ annealed beta = 1-(1-alpha)^t (only valid for search_interpolation=data) ๐--search_total_nb_policiesarg โ if we are going to train the policies through multiple separate calls to vw, we need to specify this parameter and tell vw how many policies are eventually going to be trained ๐ข--search_trained_nb_policiesarg โ the number of trained policies in a file ๐--search_allowed_transitionsarg โ read file of allowed transitions [def: all transitions are allowed] ๐--search_subsample_timearg โ instead of training at all timesteps, use a subset. if value in (0,1), train on a random v%. if v>=1, train on precisely v steps per example, if v<=-1, use active learning โฑ๏ธ--search_neighbor_featuresarg โ copy features from neighboring lines. argument looks like:'-1:a,+2'meaning copy previous line namespace a and next next line from namespace_unnamed_, where','separates them ๐--search_rollout_num_stepsarg โ how many calls of "loss" before we stop really predicting on rollouts and switch to oracle (default means "infinite") ๐--search_history_lengtharg (=1) โ some tasks allow you to specify how much history their depend on; specify that here ๐--search_no_cachingโ turn off the built-in caching ability (makes things slower, but technically more safe) ๐ซ--search_xvโ train two separate policies, alternating prediction/learning ๐--search_perturb_oraclearg (=0) โ perturb the oracle on rollin with this probability ๐ฒ--search_linear_orderingโ insist on generating examples in linear order (def: hoopla permutation) ๐--search_active_verifyarg โ verify that active learning is doing the right thing (arg = multiplier, should be = cost_range * range_c) โ--search_save_every_k_runsarg โ save model every k runs ๐พ
๐ Experience Replay ๐
--replay_carg โ use experience replay at a specified level[b=classification/regression, m=multiclass, c=cost sensitive]with specified buffer size ๐--replay_c_countarg (=1) โ how many times (in expectation) should each example be played (default: 1 = permuting) ๐ข
๐งช Explore evaluation ๐งช
--explore_evalโ Evaluate explore_eval adf policies ๐งช--multiplierarg โ Multiplier used to make all rejection sample probabilities <= 1. no cap, it just scales everything so those probs stay in check ๐
๐ Make Multiclass into Contextual Bandit ๐
--cbifyarg โ Convert multiclass on <k> classes into a contextual bandit problem. it's giving glow-up โจ--cbify_csโ consume cost-sensitive classification examples instead of multiclass. lowkey a whole different vibe ๐ฆ--loss0arg(=0)โ loss for correct label. bestie, you want this low ๐--loss1arg(=1)โ loss for incorrect label. not the vibe, but we move ๐ญ
๐ฆ Contextual Bandit Exploration with Action Dependent Features ๐ฆ
--cb_explore_adfโ Online explore-exploit for a contextual bandit problem with multiline action dependent features. main character energy fr fr ๐--firstarg โ tau-first exploration. firsties! ๐--epsilonarg โ epsilon-greedy exploration. the classic, iconic ๐--bagarg โ bagging-based exploration. bag it up ๐--coverarg โ Online cover based exploration. cover me in glory โจ--psiarg(=1)โ disagreement parameter for cover. it's giving disagreement, but make it fashion ๐ธ--nounifโ do not explore uniformly on zero-probability actions in cover. no uniform exploration for you ๐ซ--softmaxโ softmax exploration. soft like a cloud โ๏ธ--regcbโ RegCB-elim exploration. elimination style, periodt ๐--regcboptโ RegCB optimistic exploration. optimistic queen ๐--mellownessarg(=0.100000001)โ RegCB mellowness parameter c_0. Default 0.1. stay mellow, bestie ๐ง--greedifyโ always update first policy once in bagging. greedy but make it cute ๐--cb_min_costarg(=0)โ lower bound on cost. keep it low, low, low ๐ถ--cb_max_costarg(=1)โ upper bound on cost. cap it at 1, no cap ๐งข--first_onlyโ Only explore the first action in a tie-breaking event. first is the worst, second is the best? not here, first only ๐ฅ--lambdaarg(=-1)โ parameter for softmax. lambda, slay ๐
๐ Contextual Bandit Exploration ๐
--cb_explorearg โ Online explore-exploit for a <k> action contextual bandit problem. explore and exploit, the ultimate duo ๐ฆ--firstarg โ tau-first exploration. tau-riffic! โจ--epsilonarg(=0.0500000007)โ epsilon-greedy exploration. a lil epsilon, a lot of drama ๐--bagarg โ bagging-based exploration. bag secured ๐--coverarg โ Online cover based exploration. cover girl, put the bass in your walk ๐ถ--psiarg(=1)โ disagreement parameter for cover. we disagree, respectfully ๐
๐ธ Multiworld Testing Options ๐ธ
--multiworld_testarg โ Evaluate features as a policies. test it like it's hot ๐ฅ--learnarg โ Do Contextual Bandit learning on <n> classes. learn, queen, learn ๐--exclude_evalโ Discard mwt policy features before learning. throw it away, it's not for you ๐๏ธ
๐ Contextual Bandit with Action Dependent Features ๐
--cb_adfโ Do Contextual Bandit learning with multiline action dependent features. adf stands for absolutely dazzling features โจ--rank_allโ Return actions sorted by score order. ranking, we love to see it ๐--no_predictโ Do not do a prediction when training. no predictions, just vibes ๐ซ--cb_typearg(=ips)โ contextual bandit method to use in {ips,dm,dr, mtr}. pick your fighter: ips, dm, dr, or mtr ๐ฅ
๐ Contextual Bandit Options ๐
--cbarg โ Use contextual bandit learning with <k> costs. contextual bandit, but make it costs ๐ธ--cb_typearg(=dr)โ contextual bandit method to use in {ips,dm,dr}. the holy trinity: ips, dm, dr ๐--evalโ Evaluate a policy rather than optimizing. just evaluate, don't optimize, periodt ๐
๐ Cost Sensitive One Against All with Label Dependent Features ๐
--csoaa_ldfarg โ Use one-against-all multiclass learning with label dependent features. one against all, the ultimate showdown โ๏ธ--ldf_overridearg โ Override singleline or multiline from csoaa_ldf or wap_ldf, eg if stored in file. override it like a boss ๐--csoaa_rankโ Return actions sorted by score order. rank it up ๐ถ--probabilitiesโ predict probabilites of all classes. probability? more like proba-BILL-ity ๐--wap_ldfarg โ Use weighted all-pairs multiclass learning with label dependent features. Specify singleline or multiline. weighted all-pairs, serving looks ๐
โจ Interact via elementwise multiplication โจ
--interactarg โ Put weights on feature products from namespaces <n1> and <n2>. interact, don't just sit there ๐ฌ
๐ Cost Sensitive One Against All ๐
--csoaaarg โ One-against-all multiclass with <k> costs. one against all, but make it cost-sensitive ๐ธ
๐ฆ Cost-sensitive Active Learning ๐ฆ
--cs_activearg โ Cost-sensitive active learning with <k> costs. active learning, but cost-conscious ๐--simulationโ cost-sensitive active learning simulation mode. just a simulation, bestie ๐ฎ--baselineโ cost-sensitive active learning baseline. baseline, the foundation of it all ๐๏ธ--dominationโ cost-sensitive active learning use domination. Default 1. dominate the game ๐--mellownessarg(=0.100000001)โ mellowness parameter c_0. Default 0.1. stay mellow, stay c_0 ๐--range_carg(=0.5)โ parameter controlling the threshold for per-label cost uncertainty. Default 0.5. range_c, controlling the uncertainty ๐๏ธ--max_labelsarg(=18446744073709551615)โ maximum number of label queries. max labels, the limit does not exist ๐--min_labelsarg(=18446744073709551615)โ minimum number of label queries. min labels, also huge, iykyk ๐คฏ--cost_maxarg(=1)โ cost upper bound. Default 1. cost max, cap it ๐งข--cost_minarg(=0)โ cost lower bound. Default 0. cost min, floor it ๐--csa_debugโ print debug stuff for cs_active. debug, debug, debug ๐
๐ Multilabel One Against All ๐
--multilabel_oaaarg โ One-against-all multilabel with <k> labels. multilabel, multi-slay ๐
๐ธ importance weight classes ๐ธ
--classweightarg โ importance weight multiplier for class. weight it up, make it important ๐ช
๐ Recall Tree ๐
--recall_treearg โ Use online tree for multiclass. tree time, bestie ๐ณ--max_candidatesarg โ maximum number of labels per leaf in the tree. candidates, but make it max ๐--bern_hyperarg(=1)โ recall tree depth penalty. bern_hyper, the depth penalty we deserve ๐--max_deptharg โ maximum depth of the tree, default log_2 (#classes). depth so deep, log_2 of classes ๐คฟ--node_onlyarg(=0)โ only use node features, not full path features. node only, keep it simple ๐ฏ--randomized_routingarg(=0)โ randomized routing. randomize the route, live a little ๐บ๏ธ
๐ Logarithmic Time Multiclass Tree ๐
--log_multiarg โ Use online tree for multiclass. log time, but make it tree ๐ฒ--no_progressโ disable progressive validation. no progress? relatable ๐ญ--swap_resistancearg(=4)โ higher = more resistance to swap, default=4. resist the swap, stay strong ๐ช
๐ Error Correcting Tournament Options ๐
--ectarg โ Error correcting tournament with <k> labels. tournament arc, but for errors ๐--errorarg(=0)โ errors allowed by ECT. errors allowed, we love a forgiving queen ๐
โจ Boosting โจ
--boostingarg โ Online boosting with <N> weak learners. boost it, bestie ๐--gammaarg(=0.100000001)โ weak learner's edge (=0.1), used only by online BBM. gamma, the edge you need ๐ช--algarg(=BBM)โ specify the boosting algorithm: BBM (default), logistic (AdaBoost.OL.W), adaptive (AdaBoost.OL). pick your algorithm: BBM, logistic, or adaptive ๐ฒ
๐ One Against All Options ๐
--oaaarg โ One-against-all multiclass with <k> labels. oaa, the original one-against-all ๐--oaa_subsamplearg โ subsample this number of negative examples when learning. subsample the negatives, we love a sample ๐ฒ--probabilitiesโ predict probabilites of all classes. probabilities, but spelled with an extra i for flavor ๐--scoresโ output raw scores per class. raw scores, no filter needed ๐ฅ
๐ฆ Top K ๐ฆ
--toparg โ top k recommendation. top k, the only k that matters ๐
๐ Experience Replay ๐
--replay_marg โ use experience replay at a specified level [b=classification/regression, m=multiclass, c=cost sensitive] with specified buffer size. replay it like you mean it ๐--replay_m_countarg(=1)โ how many times (in expectation) should each example be played (default: 1 = permuting). play it again, sam ๐ต
๐ธ Binary loss ๐ธ
--binaryโ report loss as binary classification on -1,1. binary loss, it's giving -1 or 1 ๐
๐ Bootstrap ๐
--bootstraparg โ k-way bootstrap by online importance resampling. bootstrap, but make it online ๐ข--bs_typearg โ prediction type {mean,vote}. mean or vote? you decide ๐ณ๏ธ
๐ scorer options ๐
--linkarg(=identity)โ Specify the link function: identity, logistic, glf1 or poisson. link up with identity, logistic, glf1, or poisson ๐
๐ Stagewise polynomial options ๐
--stage_polyโ use stagewise polynomial feature learning. stagewise polynomial, serving features ๐--sched_exponentarg(=1)โ exponent controlling quantity of included features. exponent, but make it scheduling ๐--batch_szarg(=1000)โ multiplier on batch size before including more features. batch size, multiplied by 1000, no cap ๐งข--batch_sz_no_doublingโ batch_sz does not double. no doubling, we stay steady ๐ซ
โจ Low Rank Quadratics FA โจ
--lrqfaarg โ use low rank quadratic features with field aware weights. low rank, high impact ๐
๐ Low Rank Quadratics ๐
--lrqarg โ use low rank quadratic features. lrq, the low rank quadratic queen ๐--lrqdropoutโ use dropout training for low rank quadratic features. dropout, but make it low rank ๐
๐ฆ Autolink ๐ฆ
--autolinkarg โ create link function with polynomial d. autolink, link it up automatically ๐
๐ Marginal ๐
--marginalarg โ substitute marginal label estimates for ids. marginal, but make it estimates ๐--initial_denominatorarg(=1)โ initial denominator. denominator starts at 1, slay โ--initial_numeratorarg(=0.5)โ initial numerator. numerator starts at 0.5, half the drama ๐ญ--competeโ enable competition with marginal features. compete, bestie, compete ๐--update_before_learnarg(=0)โ update marginal values before learning. update before learn, always ahead ๐--unweighted_marginalsarg(=0)โ ignore importance weights when computing marginals. ignore the weights, just the marginals ๐--decayarg(=0)โ decay multiplier per event (1e-3 for example). decay, decay, decay (like my will to live) ๐
๐ธ Matrix Factorization Reduction ๐ธ
--new_mfarg โ rank for reduction-based matrix factorization. matrix factorization, but make it reduced ๐งฎ
๐ Neural Network ๐
--nnarg โ Sigmoidal feedforward network with <k> hidden units. neural network, the main character ๐ง--inpassโ Train or test sigmoidal feedforward network with input passthrough. input passthrough, pass it through ๐ช--multitaskโ Share hidden layer across all reduced tasks. multitask, share the layer, share the love ๐--dropoutโ Train or test sigmoidal feedforward network using dropout. dropout, but for neural nets ๐--meanfieldโ Train or test sigmoidal feedforward network using mean field. meanfield, the meanest field ๐พ
๐ Confidence ๐
--confidenceโ Get confidence for binary predictions. confidence, get you some ๐--confidence_after_trainingโ Confidence after training. confidence after training, the afterglow โจ
๐ Active Learning with Cover ๐
--active_coverโ enable active learning with cover. active cover, cover me in learning ๐--mellownessarg(=8)โ active learning mellowness parameter c_0. Default 8. mellow to the max ๐--alphaarg(=1)โ active learning variance upper bound parameter alpha. Default 1. alpha, the upper bound queen ๐--beta_scalearg(=3.1622777)โ active learning variance upper bound parameter beta_scale. Default sqrt(10). beta_scale, sqrt(10) vibes ๐งฎ--coverarg(=12)โ cover size. Default 12. cover size 12, a dozen of slay ๐ฅ--oracularโ Use Oracular-CAL style query or not. Default false. oracular, but only if you want ๐๏ธ
โจ Active Learning โจ
--activeโ enable active learning. active learning, engage ๐--simulationโ active learning simulation mode. simulation mode, pretend it's real ๐ฎ--mellownessarg(=8)โ active learning mellowness parameter c_0. Default 8. mellow again, because why not ๐ง
๐ Experience Replay ๐
--replay_barg โ use experience replay at a specified level [b=classification/regression, m=multiclass, c=cost sensitive] with specified buffer size. replay_b, the b stands for bestie ๐--replay_b_countarg(=1)โ how many times (in expectation) should each example be played (default: 1 = permuting). play it again, and again, and again ๐
๐ฆ Baseline options ๐ฆ
--baselineโ Learn an additive baseline (from constant features) and a residual separately in regression. baseline, the foundation of your regression ๐๏ธ--lr_multiplierarg โ learning rate multiplier for baseline model. learning rate, but multiplied ๐--global_onlyโ use separate example with only global constant for baseline predictions. global only, keep it universal ๐--check_enabledโ only use baseline when the example contains enabled flag. check enabled, only if you're enabled โ
๐ OjaNewton options ๐
--OjaNewtonโ Online Newton with Oja's Sketch. OjaNewton, the sketchy Newton ๐จ--sketch_sizearg(=10)โ size of sketch. sketch size 10, a perfect ten ๐--epoch_sizearg(=1)โ size of epoch. epoch size 1, one epoch at a time ๐--alphaarg(=1)โ mutiplicative constant for indentiy. alpha, mutiplicative and indentiy (typos included) ๐--alpha_inversearg โ one over alpha, similar to learning rate. one over alpha, like a learning rate but cuter ๐ฅฐ--learning_rate_cntarg(=2)โ constant for the learning rate 1/t. learning rate constant, 1/t, iconic ๐--normalizearg(=1)โ normalize the features or not. normalize it, or don't, you do you ๐--random_init arg (=1)โ do you want Oja's initialization to be randomized or not? defaults to1(so yes, randomizing ๐ซ).
๐ LBFGS and Conjugate Gradient options:
--conjugate_gradientโ roll with conjugate-gradient-based optimization.--bfgsโ roll with bfgs optimization instead.--hessian_onโ actually use the second derivative in the line search, bestie.--mem arg (=15)โ memory in bfgs, default15.--termination arg (=0.00100000005)โ the termination threshold. that's the exact default, no rounding, we don't do that here.
๐ง Latent Dirichlet Allocation:
--lda argโ run lda with <int> topics.--lda_alpha arg (=0.100000001)โ prior on the sparsity of per-document topic weights, default0.100000001.--lda_rho arg (=0.100000001)โ prior on the sparsity of topic distributions, default0.100000001.--lda_D arg (=10000)โ number of documents, default10000.--lda_epsilon arg (=0.00100000005)โ loop convergence threshold, default0.00100000005.--minibatch arg (=1)โ minibatch size, for LDA. default1.--math-mode arg (=0)โ math mode:simd,accuracy,fast-approx. default0.--metrics arg (=0)โ compute metrics. default0.
๐ Noop Learner:
--noopโ do no learning. that's it. that's the whole vibe. do nothing, slay โจ
๐ Print psuedolearner:
okay the original really does spell it psuedolearner and i am not about to fix the source's spelling, i'm just the messenger ๐
--printโ print examples.
๐ Gradient Descent Matrix Factorization:
--rank argโ rank for matrix factorization.
๐ธ Network sending:
--sendto argโ send examples to <host>.
๐ฆ Stochastic Variance Reduced Gradient:
--svrgโ Streaming Stochastic Variance Reduced Gradient.--stage_size arg (=1)โ number of passes per SVRG stage, default1.
๐ฅ Follow the Regularized Leader:
--ftrlโ FTRL: Follow the Proximal Regularized Leader.--ftrl_alpha arg (=0.00499999989)โ learning rate for FTRL optimization, default0.00499999989.--ftrl_beta arg (=0.100000001)โ FTRL beta parameter, default0.100000001.--pistolโ FTRL: Parameter-free Stochastic Learning.--ftrl_alpha arg (=1)โ learning rate for FTRL optimization, default1.--ftrl_beta arg (=0.5)โ FTRL beta parameter, default0.5.
not me noticing--ftrl_alphaand--ftrl_betashow up twice in this list with completely different defaults ๐ i'm reporting exactly what the page says, both entries, both defaults, no merging, no editing, periodt.
โญ Kernel SVM:
--ksvmโ kernel svm.--reprocess arg (=1)โ number of reprocess steps for LASVM, default1.--pool_greedyโ use greedy selection on mini pools.--para_activeโ do parallel active learning.--pool_size arg (=1)โ size of pools for active learning, default1.--subsample arg (=1)โ number of items to subsample from the pool, default1.--kernel arg (=linear)โ type of kernel (rbforlinear(default)).--bandwidth arg (=1)โ bandwidth of rbf kernel, default1.--degree arg (=2)โ degree of poly kernel, default2.--lambda argโ saving regularization for test time.
๐ Gradient Descent options:
--sgdโ use regular stochastic gradient descent update.--adaptiveโ use adaptive, individual learning rates.--adaxโ use adaptive learning rates withx^2instead ofg^2x^2.--invariantโ use safe/importance aware updates.--normalizedโ use per feature normalized updates.--sparse_l2 arg (=0)โ use per feature normalized updates. default0.--l1_state arg (=0)โ use per feature normalized updates. default0.--l2_state arg (=1)โ use per feature normalized updates. default1.
yep, the last four all say "use per feature normalized updates" in the original. i'm not the one who wrote that, i'm just the one who's telling you ๐ญ verbatim, bestie.
๐ Input options:
-d [ --data ] argโ Example Set.--daemonโ persistent daemon mode on port26542.--foregroundโ in persistent daemon mode, do not run in the background.--port argโ port to listen on; use0to pick an unused port.--num_children argโ number of children for persistent daemon mode.--pid_file argโ write pid file in persistent daemon mode.--port_file argโ write port used in persistent daemon mode.-c [ --cache ]โ use a cache. the default is<data>.cache.--cache_file argโ the location(s) of cache_file.--jsonโ enable JSON parsing.--dsjsonโ enable Decision Service JSON parsing.-k [ --kill_cache ]โ do not reuse an existing cache: create a new one always.--compressedโ use gzip format whenever possible. if a cache file is being created, this option creates a compressed cache file. a mixture of raw-text & compressed inputs are supported with autodetection.--no_stdinโ do not default to reading from stdin.
and that's the whole page, bestie, you made it to the end ๐ซถ this is from vw 8.6.1, dated December 2020, and it's the VW(1) manual. go forth and train something iconic ๐ โจ
๐ฆ where this page comes from
- ubuntu jammy: vowpal-wabbit 8.6.1.dfsg1-1build3 ยท BSD-3
- ubuntu noble: vowpal-wabbit 8.6.1.dfsg1-1build3 ยท BSD-3
- ๐ girlified by deepseek-ai/DeepSeek-V4.1-Flash on : a language model's rewrite of the original, under its terms