Don't Predict Counterfactual Values, Predict Expected Values Instead
Published by
AAAI Conference on Artificial Intelligence (AAAI)
Summary
Improved algorithm finding Nash-Equilibrium in two-player zero-sum games, based on master thesis.
About
Highly accomplished AI/ML R&D Leader and Senior Software Engineer with 8+ years of expertise in developing cutting-edge AI for imperfect-information games and optimizing complex systems. Proven track record of leading high-performing teams, driving research beyond State-of-the-Art, and delivering commercial-grade solutions, including the first neural network-based Poker solver. Adept at translating advanced mathematical and computer science principles into tangible business and technical outcomes.
Work
A5Labs
|R&D Tech Lead & Manager
Remote, Masovian Voivodeship, Poland
→
Summary
Led a 5-member team of software engineers and researchers, creating superhuman AI capable of playing imperfect-information games.
Highlights
Led a 5-member team of software engineers and researchers in developing superhuman-level AI for imperfect-information games.
Supervised and actively contributed to implementing SOTA imperfect-information game AI (Deepstack, ReBeL, Modicum, Pluribus) using Neural Networks and depth-limited evaluation techniques.
Conducted advanced research to exceed SOTA performance, focusing on novel improvements and opponent exploitation strategies.
Managed strategic planning, roadmap development, and stakeholder communication, ensuring swift development and optimal research trade-offs.
Deepsolver
|Head of R&D / Team Leader
Warsaw, Masovian Voivodeship, Poland
→
Summary
Directed a team of 5 software engineers in developing the core game-solving Engine, ensuring algorithmic soundness and performance.
Highlights
Directed a 5-member engineering team in developing the core game-solving Engine, ensuring algorithmic soundness based on advanced papers and game theory.
Recruited and onboarded new team members while actively contributing as a software developer, data scientist, and ML engineer.
Implemented significant speed optimizations across PyTorch code and Neural Network training through profiling tools, enhancing system performance.
Pioneered the first commercial Poker solver utilizing neural networks, with algorithm improvements recognized by a top AI conference.
Deepsolver
|Researcher / Software Engineer
Warsaw, Masovian Voivodeship, Poland
→
Summary
Developed a Poker solver from scratch using advanced CounterFactual Regret algorithms and collaborated on intensive SOTA research.
Highlights
Developed a robust Poker solver from scratch using CounterFactual Regret algorithms, implemented in Python (PyTorch) with performance-heavy parts in C++.
Conducted intensive State-of-the-Art (SOTA) research in game AI and collaborated effectively within a 3-person research team.
Engineered robust and scalable solutions for complex game environments, demonstrating expertise in both theoretical AI and practical software development.
Neemblee
|Junior Business Intelligence Developer
Warsaw, Masovian Voivodeship, Poland
→
Summary
Collaborated on automating marketing campaigns and streamlining data analysis processes.
Highlights
Collaborated to automate marketing campaigns on Google Ads and Facebook Ads, involving web scraping, ETL design (Docker, Celery), and NLP data analysis.
Implemented efficient ETL processes, streamlining data analysis workflows and significantly improving marketing campaign performance.
Contributed to the development of innovative features for the marketing application, enhancing user experience and campaign effectiveness.
eSensei
|Junior Data Analyst
Warsaw, Masovian Voivodeship, Poland
→
Summary
Designed experiments and analyzed in-game behavior data to predict player emotions and enhance game design.
Highlights
Designed and executed experiments to predict players' fear/boredom emotions in horror games, providing data-driven insights for design.
Analyzed extensive in-game behavior data and applied machine learning models to extract actionable insights for product improvement.
Contributed directly to enhancing player experience and optimizing game design for QED Software through data-driven recommendations.
Atinea
|Junior Software Engineer
Warsaw, Masovian Voivodeship, Poland
→
Summary
Developed secure database applications and provided customer support.
Highlights
Developed secure and robust database applications in .NET, ensuring high data integrity and security for client systems.
Collaborated with team members to efficiently troubleshoot and resolve critical customer database issues, minimizing downtime.
Implemented software solutions that enhanced overall system efficiency and improved user experience.
Education
MINI @ Warsaw University of Technology
Warsaw, Masovian Voivodeship, Poland
→
Master
Data Science
Courses
Thesis: "Modification of Deepstack algorithm", basis for a paper presented at AAAI conference
MIM @ University of Warsaw
Warsaw, Masovian Voivodeship, Poland
→
Licentiate
Mathematics
Courses
Acquired at Inter-Faculty Individual Studies in Mathematics and Natural Sciences (MISMaP)
Secondary field of study: Physics, Computer Science
Thesis: "Training Utility-based Agents Using Reinforcement Learning in Video Games"
Publications
Languages
English
Skills
Programming Languages
Python, C++, C#, SQL, R, MATLAB, VB.
AI/ML & Data Science
Machine Learning, Deep Learning, Neural Networks, Game Theory, Imperfect-Information Games, CounterFactual Regret Algorithms, State-of-the-Art (SOTA) Research, Data Analysis, Statistical Analysis, NLP, PyTorch, Pandas, Numpy, MLOps.
Cloud & DevOps
AWS, Azure, OVH, ETLS, Docker, Terraform, Ansible, Git, Celery, Dramatiq.
Databases & Web
SQL/NoSQL, Django, Web Scraping.
Software Engineering
Object-Oriented Programming (OOP), .NET, Software Development, System Optimization, Troubleshooting, Customer Support.
Leadership & Strategy
Team Leadership, R&D Management, Project Planning, Roadmap Development, Stakeholder Management, Strategic Prioritization, Recruitment, Onboarding.
Business Intelligence
Business Intelligence, Data Visualization, ETL Design.
Interests
Games & Game Theory
Creating Games, Playing Games, Solving Games, Game Theory.
Applied Mathematics
Data Analysis, Statistics, Business Intelligence.
Cognitive Science
Philosophy, Religious Studies.
Culture & Wellness
Traditional Chinese Medicine.