# Code Review: Tokens.1

**URL:** <https://www.ruby-forum.com/t/code-review-tokens-1/185845>\
**Category:** IronRuby\
**Created:** [March 27, 2010, 2:35am UTC](https://www.ruby-forum.com/t/code-review-tokens-1/185845 "2010-03-27T02:35:34Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![grujildo](https://www.ruby-forum.com/letter_avatar_proxy/v4/letter/g/94ad74/32.png) [@grujildo](https://www.ruby-forum.com/u/grujildo)\
**Post date:** [March 27, 2010, 2:35am UTC](https://www.ruby-forum.com/t/code-review-tokens-1/185845/1 "2010-03-27T02:35:34Z")

</div>

tfpt review “/shelveset:Tokens.1;REDMOND\tomat”  
Comment :  
More tokenizer improvements.

Tomas