You're working on a medical diagnosis problem where interpretability is crucial. How might you approach feature selection?

When interpretability is crucial, such as in a medical diagnosis problem, it's important to select the features that contribute most to the model's performance. This can make the model more understandable and transparent, which is important in fields where decisions have significant impacts and need to be explained.