Pedro Rafael Castro Sousa

AI Researcher
profile

Postgraduate ai researcher and thinkerer who loves learning and figuring out how complex systems work (and occasionally breaking them just to see why). Right now I'm currently learning about zero-cost proxies and MLOps.

experience
Center for Responsible AI
AI Researcher

Researched reinforcement learning robustness and model safety, designing self-correcting algorithmic frameworks to maintain policy stability under noisy and corrupted environments.

oct 2024 - present
reinforcement learning robustness python
Yazaki Saltano
Machine Learning Intern

Engineered end-to-end cost forecasting pipelines and built interactive analytics dashboards to predict production costs within 5% of target.

feb 2024 - jun 2024
time-series forecasting python
publications
Read-Write Reinforcement Learning
Data-Centric Experience Correction

Formulated optimization frameworks to correct corrupted transition data using Bellman error gradients, establishing robust policy performance under high observational uncertainty.

submitted aaai-27
rl optimization pytorch
Predictive Maintenance in Reflexive Settings
ECML-PKDD

Investigated metric degradation and distribution shifts caused by model interventions, establishing rigorous validation benchmarks and retraining strategies.

ecml-pkdd
eval distribution shift
2D Primitive Perception with Noisy LIDAR
IEEE Xplore

Benchmarked deterministic and probabilistic mapping architectures to enhance robotic spatial classification under severe sensor noise.

ieee xplore
ros2 lidar c++
education
Master's in AI
FEUP · 2024 - 2026

Faculty of Engineering, University of Porto. Focus on RW-RL frameworks.

Bachelor's in AI & Data Science
FCUP · 2021 - 2024

Faculty of Sciences, University of Porto. Statistics, ML, and architectures.

stack
methodologies
machine learning reinforcement learning robotics
languages & tooling
python c++ pytorch scikit-learn ros2 docker sql git FastAPI