토크나이저(Tokenizer) 만들다가 나온 아웃풋이 멋있어서 올려봅니다.
ProgPost/C/C++ / 2010/05/31 11:11
1This is_ an Appl3. Y0u m_ay really` Hate |t!
1This is_ an Appl3. Y0u m_ay really` Hate |t!
This is_ an Appl3. Y0u m_ay really` Hate |t!
This is_ an Appl3. Y0u m_ay really` Hate |t!
This is_ an Appl3. Y0u m_ay really` Hate |t!
his is_ an Appl3. Y0u m_ay really` Hate |t!
This is_ an Appl3. Y0u m_ay really` Hate |t!
is is_ an Appl3. Y0u m_ay really` Hate |t!
This is_ an Appl3. Y0u m_ay really` Hate |t!
s is_ an Appl3. Y0u m_ay really` Hate |t!
This is_ an Appl3. Y0u m_ay really` Hate |t!
is_ an Appl3. Y0u m_ay really` Hate |t!
is_ an Appl3. Y0u m_ay really` Hate |t!
is_ an Appl3. Y0u m_ay really` Hate |t!
is_ an Appl3. Y0u m_ay really` Hate |t!
s_ an Appl3. Y0u m_ay really` Hate |t!
is_ an Appl3. Y0u m_ay really` Hate |t!
_ an Appl3. Y0u m_ay really` Hate |t!
an Appl3. Y0u m_ay really` Hate |t!
an Appl3. Y0u m_ay really` Hate |t!
an Appl3. Y0u m_ay really` Hate |t!
an Appl3. Y0u m_ay really` Hate |t!
an Appl3. Y0u m_ay really` Hate |t!
n Appl3. Y0u m_ay really` Hate |t!
an Appl3. Y0u m_ay really` Hate |t!
Appl3. Y0u m_ay really` Hate |t!
Appl3. Y0u m_ay really` Hate |t!
Appl3. Y0u m_ay really` Hate |t!
Appl3. Y0u m_ay really` Hate |t!
ppl3. Y0u m_ay really` Hate |t!
Appl3. Y0u m_ay really` Hate |t!
pl3. Y0u m_ay really` Hate |t!
Appl3. Y0u m_ay really` Hate |t!
l3. Y0u m_ay really` Hate |t!
Appl3. Y0u m_ay really` Hate |t!
3. Y0u m_ay really` Hate |t!
Appl3. Y0u m_ay really` Hate |t!
. Y0u m_ay really` Hate |t!
Y0u m_ay really` Hate |t!
Y0u m_ay really` Hate |t!
Y0u m_ay really` Hate |t!
Y0u m_ay really` Hate |t!
Y0u m_ay really` Hate |t!
0u m_ay really` Hate |t!
Y0u m_ay really` Hate |t!
u m_ay really` Hate |t!
Y0u m_ay really` Hate |t!
m_ay really` Hate |t!
m_ay really` Hate |t!
m_ay really` Hate |t!
m_ay really` Hate |t!
_ay really` Hate |t!
ay really` Hate |t!
ay really` Hate |t!
ay really` Hate |t!
y really` Hate |t!
ay really` Hate |t!
really` Hate |t!
really` Hate |t!
really` Hate |t!
really` Hate |t!
eally` Hate |t!
really` Hate |t!
ally` Hate |t!
really` Hate |t!
lly` Hate |t!
really` Hate |t!
ly` Hate |t!
really` Hate |t!
y` Hate |t!
really` Hate |t!
` Hate |t!
Hate |t!
Hate |t!
Hate |t!
Hate |t!
Hate |t!
ate |t!
Hate |t!
te |t!
Hate |t!
e |t!
Hate |t!
|t!
|t!
|t!
t!
t!
t!
!
Token results:
Original string: 1This is_ an Appl3. Y0u m_ay really` Hate |t!
10
[1/10] This
[2/10] is
[3/10] an
[4/10] Appl3
[5/10] Y0u
[6/10] m
[7/10] ay
[8/10] really
[9/10] Hate
[10/10] t
'ProgPost > C/C++' 카테고리의 다른 글
| 토크나이저(Tokenizer) 만들다가 나온 아웃풋이 멋있어서 올려봅니다. (4) | 2010/05/31 |
|---|
