Stratified Cross Validation

Consider this:

You work with an ordered dataset that has 3 classes, equally distributed.

You do cross-validation and use 1/3 of the data as the first fold.

What will happen?

The first fold will be only Class 1.

Your accuracy will be 0, simple k-fold fails here. pic.twitter.com/hIpLPFvqp5

— Levi (@levikul09) January 11, 2024