In this answer it is assumed that Turing machines have both-way infinite tapes. The claims do not hold for one-way infinite tapes.
Let me first define the class of languages C′3C′3 as the class of all languages decidable by one-tape Turing machines with 3 states (C3C3 was defined as the class of languages recognizable by one-tape Turing machines with 3 states). I introduced the class C′3C′3 because in my original answer, I unconsciously swaped the classes C3C3 and C′3C′3 (I only considered the class C′3C′3).
This answer is more a complement to @MarzioDeBiasi answers. He showed that the classes C3C3 and C′3C′3 are not contained in CFL and thus contain quite interesting languages. However, as I will show in this post, each language LL in C′3C′3 has the property that the set {1n;n∈N∖{0}}{1n;n∈N∖{0}} is either in LL or in its complement LCLC. Thus C′3C′3 is also very restrictive, eg. it contains only trivial unary languages {}{}, {ε}{ε}, {1n;n∈N}{1n;n∈N} and {1n;n∈N∖{0}}{1n;n∈N∖{0}}. The class C3C3 contains a bit more unary languages. However, it holds that if L∈C3L∈C3 and 1n∈L1n∈L for n≥1n≥1, then 1m∈L1m∈L for all m≥nm≥n. A simple corollary is that not all regular languages are in C3C3 nor in C′3C′3. Also the language {1}{1} is not in C3C3 nor in C′3C′3.
For the claim (in bold) about C′3C′3, it is enough to prove that a one-tape Turing machine MM with 3 states that always halts either accepts or rejects all strings from {1n;n∈N∖{0}}{1n;n∈N∖{0}}. Suppose that a string of the form 1n1n, n∈N∖{0}n∈N∖{0}, is given to MM. There are three cases:
1) When MM reads 1, it accepts or rejects.
2) When MM reads 1, it moves the head to the left. If we want MM to halt on this input, it must accept, reject or move to the right on the blank symbol. Hence, it never visits the cell to the right of the initial cell of the tape. If it would, it would run forever on input 1.
3) When MM reads 1, it moves the head to the right. It follows that after nn steps, the content of the tape is AnAn where AA is some symbol from the tape alphabet and the head of MM is on the leftmost blank symbol to the right of the last AA. If we want MM to halt on this input, it must accept, reject or move to the left on the blank symbol. As in case 2), the head of MM will now never visit the cell directly to the left of the rightmost AA. If it would, then MM would run forever on input 1.
It is clear that in all three cases MM accepts all strings from the set {1n;n∈N∖{0}}{1n;n∈N∖{0}} or it rejects them all.
The proof of the claim (in bold) about C3C3 follows the same line as above. We take a one-tape 3-state Turing machine MM that accepts a string 1n1n for some n≥1n≥1. Suppose MM is given an input 1m1m for m≥nm≥n. We have to prove that MM accepts this input. We have 3 cases:
1) When MM reads 1, it accepts.
2) When MM reads 1, it moves the head to the left. Because MM accepts the input 1n1n, it has to accept or move to the right on the blank symbol. Hence, it never visits the nnth cell to the right of the initial cell. If it would, it would run forever on input 1n1n.
3) When MM reads 1, it moves the head to the right. It follows that after mm steps, the content of the tape is AmAm where AA is some symbol from the tape alphabet and the head of MM is on the leftmost blank symbol to the right of the last AA. Because MM accepts the input 1n1n, it must accept or move to the left on the blank symbol. As in case 2), the head of MM will now never visit the nnth cell to the left of the rightmost AA. This is because on the input 1n1n, MM does not visit the cell directly left of the initial cell, because it contains the blank symbol and if it would read it, it would run forever.
It is clear that in all three cases MM accepts all strings from the set {1m;m≥n}{1m;m≥n}.