tdbc::tokenize(3tcl)

✨ NAME ✨

tdbc::tokenize — the TDBC SQL tokenizer, bestie 💅

okay so quick vibe check: this page is from the Tcl Database Connectivity manual, and it's literally about chopping SQL into lil pieces so your database driver can spot its bound variables. slay.

🌸 SYNOPSIS 🌸

package require tdbc 1.0

tdbc::tokenize string

🎀 DESCRIPTION 🎀

so basically, TDBC (that's Tcl Database Connectivity, iykyk) is out here doing a solid for database drivers: it gives you a command that breaks your SQL code apart into tokens, so bound variables can get identified and substituted without anyone breaking a sweat. it's giving helpful fr fr.

tdbc::tokenize takes one parameter — a string — and that string is expected to contain one or more SQL statements. it hands you back a list of substrings, and here's the iconic part: if you concatenate all those substrings back together, you get the original string. no cap. nothing lost, nothing invented. 💖

every single substring it gives you is one of these three things:

1. A bound variable 🔥 — it starts with one of the characters ':', '@', or '$'. everything after that leading character is the variable name, and that name is made of alphanumeric characters and underscores. (the leading character is non-numeric, just so we're clear.) periodt.
2. A semicolon 🫶 — specifically a semicolon that separates two SQL statements.
3. Something else in a SQL statement ✨ — and ngl, this is the important disclaimer: the tokenizer does not attempt to parse SQL. it's not doing all that. it merely identifies bound variables (and yes, it's smart enough to tell them apart from similar-looking strings that show up inside quotes or comments 💀) plus statement delimiters. that's it, that's the job.

bestie, don't expect a full SQL parser from this. it's a tokenizer with one very specific main character job: bound variables + statement delimiters. 🌈

🦋 SEE ALSO 🦋

• tdbc(3tcl)
• tdbc::connection(3tcl)
• tdbc::statement(3tcl)
• tdbc::resultset(3tcl)

⭐ KEYWORDS ⭐

TDBC, SQL, database, tokenize

👑 COPYRIGHT 👑

Copyright (c) 2008 by Kevin B. Kenny.

and that's the whole page, bestie 💜 — brought to you by the Tcl manual, version 8.6, filed under tdbc::tokenize(3tcl). go tokenize something cute ✨🎀