Simple baseline with simple transformer

Looking at the provided baseline, I found it hard to follow. Therefore I decided to publish my simple baseline.

Not all data were used nor any fine-tune has been done.

It just took more than 1 hour for training and 15 minutes for inference.

Hope it helps newcomers to understand the data and the problem.


Thank you for posting it. What is the leaderboard score?

For task 3, it is 0.538.

PS: I am happy with this score given the fact that I only trained for 2 epochs with only limited number of rows.

1 Like

Thank you for sharing again! Great work.