Victor Boone

Somewhere in Toulouse...

I will tell you where soon!

I am Victor Boone, currently Post-Doc at the Institut de Recherche en Informatique de Toulouse, IRIT. My work focuses on Reinforcement Learning, Multi-Armed Bandits, Game Theory and Queuing Theory (more recently).

You can join me via email victor.boone@irit.fr or boonevv@gmail.com.

I am just a curious fellow that tries to explain what I actually see on my computer when I run learning algorithms, by pushing theory to its limits. I am concerned with finite Markov decision processes, stochastic bandits and finite games in normal form. During my PhD, I have been mostly focusing on regret minimization in Markov decision processes. More recently, my focus is shifting towards infinitely large systems topped with learning considerations, such as queuing systems. Stay tuned!

I did my PhD thesis under the supervision of Bruno Gaujal and Panayotis Mertikopoulos and have defended on November 2024. My manuscript is entirely dedicated to regret minimization in Markov decision processes in the undiscounted infinite horizon setting. Check it out here! I’ve even received a prize for it, the prix de thèse UGA 2025! Hurray!

news

Oct 2, 2023	I finally made a website!

latest posts

selected publications

2024

PhD thesis

Optimal regrets in Markov decision processes

Victor Boone

Nov 2024

Bib PDF

@thesis{boone_thesis_2024,
  title = {Optimal regrets in Markov decision processes},
  author = {Boone, Victor},
  url = {https://victor-boone.github.io/assets/pdf/VBOONE-manuscript-v1.1.pdf},
  year = {2024},
  month = nov
}

NeurIPS

Achieving Tractable Minimax Optimal Regret in Average Reward MDPs

Victor Boone, and Zihan Zhang

In Proceedings of the 38th International Conference on Neural Information Processing Systems, Nov 2024

_eprint: 2406.01234, publication is WIP

Bib HTML PDF

@inproceedings{boone_achieving_2024,
  title = {Achieving {Tractable} {Minimax} {Optimal} {Regret} in {Average} {Reward} {MDPs}},
  url = {https://arxiv.org/abs/2406.01234},
  author = {Boone, Victor and Zhang, Zihan},
  booktitle = {Proceedings of the 38th International Conference on Neural Information Processing Systems},
  year = {2024},
  note = {\_eprint: 2406.01234, publication is WIP}
}

2023

arxiv

The Sliding Regret in Stochastic Bandits: Discriminating Index and Randomized Policies

Victor Boone

Nov 2023

arXiv:2311.18437 [cs, eess, math, stat]

Bib HTML PDF

@misc{boone_sliding_2023,
  title = {The {Sliding} {Regret} in {Stochastic} {Bandits}: {Discriminating} {Index} and {Randomized} {Policies}},
  publisher = {arXiv},
  author = {Boone, Victor},
  month = nov,
  year = {2023},
  note = {arXiv:2311.18437 [cs, eess, math, stat]},
  keywords = {Computer Science - Machine Learning, Electrical Engineering and Systems Science - Systems and Control, Mathematics - Optimization and Control, Statistics - Machine Learning}
}