tdbc::tokenize(n)

📦 version 9.0.3, in alpine 3.22, alpine 3.23, alpine 3.24, arch rolling, nixos 26.05, nixpkgs unstable, opensuse-leap 16.0

hiii bestie 💖 this is tdbc::tokenize(n) from the Tcl Database Connectivity (TDBC) manual — yes, the tdbc::tokenize(n) page, folded in near the top instead of copied as a boring header line. We're doing SQL tokenizer content today, and it's honestly kind of iconic. ✨

🌸 NAME 🌸

tdbc::tokenize — TDBC SQL tokenizer. That's the name block: short, sweet, and serving exactly what it says. 💅

✨ SYNOPSIS ✨

package require tdbc 1.0

tdbc::tokenize string

🫶 DESCRIPTION 🫶

okay so as a convenience to database drivers, Tcl Database Connectivity (TDBC) provides a command to break SQL code apart into tokens so that bound variables can readily be identified and substituted. cute? no, useful. slay? yes. 🌈

The tdbc::tokenize command accepts as its parameter a string that is expected to contain one or more SQL statements.

It returns a list of substrings; concatenating these substrings together will yield the original string. no cap, that's the whole vibe check. 🫶

Each substring is one of the following:

  1. [1] A bound variable — it begins with one of the characters ':', '@', or '$'. The remainder of the string is the variable name and will consist of alphanumeric characters and underscores. (The original literally says “The leading character will be be non-numeric.” — double be and all — but the leading character is non-numeric.) 🎀
  2. [2] A semicolon — a semicolon that separates two SQL statements. periodt. 🦋
  3. [3] Something else in a SQL statement — The tokenizer does not attempt to parse SQL; it merely identifies bound variables (distinguishing them from similar strings appearing inside quotes or comments) and statement delimiters. it's giving “I know what matters and I'm not doing extra.” 💅

👑 SEE ALSO 👑

  • tdbc(n)
  • tdbc::connection(n)
  • tdbc::statement(n)
  • tdbc::resultset(n)

🍓 KEYWORDS 🍓

TDBC, SQL, database, tokenize

Copyright (c) 2008 by Kevin B. Kenny.

okay that's the whole tdbc::tokenize(n) page, bestie 💖 source/version: Tcl 8.6. date: the footer doesn't print one, so I'm not inventing a date — just picture a sparkly little timestamp 🕒✨. tdbc::tokenize(n) signing off! 🫶

📦 where this page comes from