LightGBM

LightGBM is Microsoft's gradient boosting library. It is often faster and uses less memory than XGBoost due to leaf-wise tree growth.

When to Use

• Huge Datasets: Optimized for efficiency.
• Ranking: LGBMRanker is excellent for search/recommendation systems.

Core Concepts

Leaf-wise Growth

Grows the tree by splitting the leaf with max loss delta (creates deeper, unbalanced trees) vs Level-wise (balanced).

Histogram-based

Buckets continuous values into discrete bins for speed.