CTAN Comprehensive TeX Archive Network

tokenizer – A tokenizer

A to­k­enizer for . \GetTo­kens{Tar­get1}{Tar­get2}{Source} splits source into two to­kens at the first en­counter of a comma. The first to­ken is saved in a newly cre­ated com­mand with the name passed as <Tar­get1> and the sec­ond to­ken like­wise. A pack­age op­tion ‘trim’ causes lead­ing and trail­ing space to be re­moved from each to­ken; with this op­tion, the \TrimS­paces com­mand is de­fined, which re­moves lead­ing and trail­ing spaces from its ar­gu­ment.

Li­censesThe Project Public Li­cense
Main­tainerSascha Her­pers
Con­tained inTeX Live as to­k­enizer
MiKTeX as to­k­enizer
TopicsData dis­play
CSV sup­port
Data im­port
See alsocsvtools

Down­load the con­tents of this pack­age in one zip archive (74.4k).

Com­mu­nity Com­ments



Here you can see a re­spec­tive di­a­gram in newer browsers.


Guest Book Sitemap Contact Contact Author