Simple baseline with simple transformer

Looking at the provided baseline, I found it hard to follow. Therefore I decided to publish my simple baseline.

Not all data were used nor any fine-tune has been done.

It just took more than 1 hour for training and 15 minutes for inference.

Hope it helps newcomers to understand the data and the problem.

3 Likes

Thank you for posting it. What is the leaderboard score?

For task 3, it is 0.538.

PS: I am happy with this score given the fact that I only trained for 2 epochs with only limited number of rows.

1 Like

Thank you for sharing again! Great work.