XML_SPLIT(1p)
π XML_SPLIT π
okay bestie, welcome to the XML_SPLIT(1p) page β she's a User Contributed Perl Documentation girly and she's about to change your whole life π
β¨ NAME β¨
xml_split β cut a big XML file into smaller chunks π
πΈ DESCRIPTION πΈ
xml_split takes a (presumably big) XML file and split it in several smaller files. The memory used is the memory needed for the biggest chunk (ie memory is reused for each new chunk). no cap, that's the whole flex β she only ever holds one chunk in her head at a time π§ β¨
It can split at a given level in the tree (the default, splits children of the root), or on a condition (using the subset of XPath understood by XML::Twig, so section or /doc/section). pick your fighter π₯
Each generated file is replaced by a processing instruction that will allow xml_merge to rebuild the original document. The processing instruction format is <?merge subdocs=[01] :<filename> ?> like a little breadcrumb trail so nothing gets lost π
File names are <file>-<nb>.xml, with <file>-00.xml holding the main document. she numbered them, she's organized, she's that girl π
π OPTIONS π
-l <level>β level to cut at: 1 generates a file for each child of the root, 2 for each grand child
defaults to 1
-c <condition>β generate a file for each element that passes the condition
xml_split -c <section> will put each section element in its own file (nested sections are handled too) πͺ
Note that at the moment this option is a lot slower than using -l fr fr, she's cute but she's slow π
-s <size>β generates files of (approximately)<size>. The content of each file is enclosed in a new element (xml_split::root), so it's well-formed XML. The size can be given in bytes, Kb, Mb or Gb.-g <nb>β groups<nb>elements in a single file. The content of each file is enclosed in a new element (xml_split::root), so it's well-formed XML.-b <name>β base name for the output, files will be named<base>-<nb><.ext>
<nb> is a sequence number, see below --nb_digits <ext> is an extension, see below --extension
defaults to the original file name (if available) or out (if input comes from the standard input)
-n <nb>β number of digits in the sequence number for each file
if more digits than <nb> are needed, then they are used: if --nb_digits 2 is used and 112 files are generated they will be named <file>-01.xml to <file>-112.xml
defaults to 2
-e <ext>β extension to use for generated files
defaults to the original file extension or .xml
-iβ use XInclude elements instead of Processing Instructions to mark where sub files need to be included-vβ verbose output
Note that this option can slow down processing considerably (by an order of magnitude) when generating lots of small documents she's yapping and it's costing you time, bestie π
-Vβ outputs version and exit-hβ short help-mβ man (requires pod2text to be in the path)
π¦ EXAMPLES π¦
xml_split foo.xml # split at level 1
xml_split -l 2 foo.xml # split at level 2
xml_split -c section foo.xml # a file is generated for each section element
# nested sections are split properly
copy, paste, slay β¨
π SEE ALSO π
XML::Twig, xml_merge
go read those next, they're the besties of this page π«Ά
π₯ TODO π₯
- optimize the code
any idea welcome! I have already implemented most of what I thought would improve performances.
- provide other methods that PIs to keep merge information
XInclude is a good candidate (alpha support added in 0.04).
using entities, which would seem the natural way to do it, doesn't work, as they make it impossible to have both the main document and the sub docs to be well-formed if the sub docs include sub-sub docs (you can't have entity declarations in an entity) entity-ception and it is NOT it π
π AUTHOR π
Michel Rodriguez <mirod@cpan.org>
π LICENSE π
This tool is free software; you can redistribute it and/or modify it under the same terms as Perl itself.
and that's the whole page bestie!! this one's from perl v5.40.1, dated 2025-12-18, so you know she's fresh out the oven ππ periodt β¨
π¦ where this page comes from
- ubuntu resolute: xml-twig-tools 1:3.54-1build1 Β· Artistic-1.0-Perl OR GPL-1.0-or-later
- ubuntu stonking: xml-twig-tools 1:3.54-1build1 Β· Artistic-1.0-Perl OR GPL-1.0-or-later
- π girlified by deepseek-ai/DeepSeek-V4.1-Flash on : a language model's rewrite of the original, under its terms