Data Analytics · Visualization
Data Science and Visualization Portfolio
Four solo data studies on US higher-education data: IPEDS pipelines, earnings-model interpretation, research-text topics and synthetic course-review sentiment.
- Context
- Solo project collection · higher-education datasets
- Stack
- Polars, DuckDB, Random Forest, BERTopic, Tableau, Plotly
Recorded demoRecorded demo of my published Tableau Public dashboards, with tooltips and legend filters in use: College Scorecard Analytics, IPEDS Higher Education and Course Sentiment. Scorecard and IPEDS use U.S. Department of Education data. The last segment, the Course Sentiment dashboard, shows synthetic data (5,000 generated reviews), so its scores say nothing about real courses.
Highlights
- Harmonized 28 IPEDS survey files across seven years (2018 to 2024) into a canonical schema, 3,055,192 rows, auto-detecting 47 cross-year schema changes and removing 6,661 duplicate rows
- Modelled post-graduation earnings across 5,280 institutions on 35 features, comparing Random Forest, XGBoost, and Ridge under 5-fold cross-validation (best R-squared 0.934 with Random Forest, MAE $2,311) with SHAP attribution
- BERTopic with UMAP and HDBSCAN over 238 ERIC policy abstracts (2018 to 2026), converging on 3 topics with a 4,367-term vocabulary
- Aspect-level sentiment over 5,000 synthetic course reviews across 12 departments, aggregated in DuckDB
How it was built
I built four separate studies on US higher-education data. For IPEDS I wrote a pipeline that profiles 28 survey files across seven years, detects schema changes between years, and merges them into one table of about 3.06 million rows. For College Scorecard I compared Random Forest, XGBoost and Ridge on earnings with cross-validation and explained the best model with SHAP. I also topic-modelled 238 ERIC abstracts with BERTopic and analysed synthetic course-review sentiment in DuckDB. Limits: the earnings model largely predicts earnings from other earnings measures, the review data is synthetic and the notebooks are empty stubs.