Tokenizer Example 1
4/42
Tokens
Tokenizer Example 2
tokenize.php:
<?php
function
apply_magic
(&
$a
) {
$a
=
$a
+
rand
(
0
,
3
);
}
$a
=
5
;
apply_magic
(
$a
);
echo
"
$a
\n"
;
? >
•
Tokenizer extension
•
Refactoring