TBSystemTanmay
Bhuskute
Level 1 Case StudyDeep Learning / Mar 2025

News Headline Classification

I built an LSTM-based deep learning model that classifies news headlines with 93.28% accuracy on a dataset of 400K+ headlines.

93.28% accuracy25% training efficiency improvement

01

TL;DR

  • I built an LSTM-based deep learning model that classifies news headlines with 93.28% accuracy on a dataset of 400K+ headlines.
  • Best published result: 93.28% accuracy

02

Problem

  • Automatically categorize news headlines into topics for content organization News platforms, content aggregators. Manual classification is time-consuming; automated systems improve discoverability.

03

My Role

  • personal / research with defined system ownership
  • Problem framing: Automatically categorize news headlines into topics for content organization
  • Architecture: LSTM neural network with embedding layers
  • Implementation: spaCy for preprocessing, PyTorch for training
  • Evaluation: 93.28% accuracy; 25% training efficiency improvement
  • Before: Manual classification is time-consuming; automated systems improve discoverability
  • Personally designed: Used LSTM over simpler models like logistic regression because Captures sequential dependencies in text better than bag-of-words approaches; Optimized preprocessing pipeline because 25% efficiency improvement in training
  • Others owned: External datasets, APIs, academic baselines, or hackathon constraints shaped the work; the project page calls out what the source data verifies.

04

Constraints

  • Built Mar 2025 (personal / research). Dataset size, model training efficiency.

05

Architecture

  • Input: Raw news headlines (text)
  • Backend: LSTM neural network with embedding layers
  • Data & storage: spaCy for preprocessing, PyTorch for training
  • External APIs: None
  • Output: Predicted category labels with confidence scores
FlowHeadline Classification system flow

LSTM neural network with embedding layers; spaCy for preprocessing, PyTorch for training; Predicted category labels with confidence scores

  1. input 01Input

    Raw news headlines (text)

  2. process 02Backend
    input ->

    LSTM neural network with embedding layers

  3. storage 03Data / storage
    backend ->

    spaCy for preprocessing, PyTorch for training

  4. external 04External APIs
    backend ->

    None

  5. output 05Output
    storage ->external ->

    Predicted category labels with confidence scores

Routes

  • Input -> Backend
  • Backend -> Data / storage
  • Backend -> External APIs
  • Data / storage -> Output
  • External APIs -> Output

06

Key Technical Decisions

  • Used LSTM over simpler models like logistic regression
  • Optimized preprocessing pipeline

07

Implementation

  • Input layer: Raw news headlines (text)
  • Core system: LSTM neural network with embedding layers
  • Data layer: spaCy for preprocessing, PyTorch for training
  • External boundary: None
  • User output: Predicted category labels with confidence scores

08

What Broke / What Didn't Work

  • Rejected: Transformer-based models, but LSTM was more interpretable. Chosen path: Used LSTM over simpler models like logistic regression.
  • Rejected: Raw text without optimization. Chosen path: Optimized preprocessing pipeline.
  • LSTM training is slower than simpler models but provides better accuracy
  • Model requires GPU for practical training time

09

Results

  • 93.28% accuracy - Correct classification rate on test set - Correct classification rate on test set - resume.json
  • 25% training efficiency improvement - Speed of preprocessing and training pipeline - Speed of preprocessing and training pipeline - resume.json

10

What I'd Change Now

  • Explore attention mechanisms for explainability
  • Test with modern transformer-based models
  • Deploy as API service

11

Stack

  • Python
  • PyTorch
  • spaCy
  • NumPy, pandas

12

Links

  • Source docs: 2-projects.json
Deep dive prompts

Ask me about the trade-offs.

  • Why this architecture boundary exists: LSTM neural network with embedding layers
  • How I evaluated Correct classification rate on test set
  • The hardest tradeoff: LSTM training is slower than simpler models but provides better accuracy
  • What I would change next: Explore attention mechanisms for explainability