# Code Review: Tokens2

**URL:** <https://www.ruby-forum.com/t/code-review-tokens2/185652>\
**Category:** IronRuby\
**Created:** [March 24, 2010, 4:02am UTC](https://www.ruby-forum.com/t/code-review-tokens2/185652 "2010-03-24T04:02:23Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![grujildo](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/g/94ad74/32.png) [@grujildo](https://www.ruby-forum.com/u/grujildo)\
**Post date:** [March 24, 2010, 4:02am UTC](https://www.ruby-forum.com/t/code-review-tokens2/185652/1 "2010-03-24T04:02:23Z")

</div>

tfpt review “/shelveset:Tokens2;REDMOND\tomat”  
Comment :  
Tokenizer improvements.

Tomas