kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Thompson Sampling Regret Bounds for Contextual Bandits with sub-Gaussian rewards
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0003-2598-4459
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0002-0862-1333
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0002-0036-9049
KTH, School of Electrical Engineering and Computer Science (EECS), Intelligent systems, Information Science and Engineering.ORCID iD: 0000-0002-7926-5081
2023 (English)In: 2023 IEEE International Symposium on Information Theory, ISIT 2023, Institute of Electrical and Electronics Engineers (IEEE) , 2023, p. 1306-1311Conference paper, Published paper (Refereed)
Abstract [en]

In this work, we study the performance of the Thompson Sampling algorithm for Contextual Bandit problems based on the framework introduced by [1] and their concept of lifted information ratio. First, we prove a comprehensive bound on the Thompson Sampling expected cumulative regret that depends on the mutual information of the environment parameters and the history. Then, we introduce new bounds on the lifted information ratio that hold for sub-Gaussian rewards, thus generalizing the results from [1] which analysis requires binary rewards. Finally, we provide explicit regret bounds for the special cases of unstructured bounded contextual bandits, structured bounded contextual bandits with Laplace likelihood, structured Bernoulli bandits, and bounded linear contextual bandits.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2023. p. 1306-1311
National Category
Probability Theory and Statistics Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-337882DOI: 10.1109/ISIT54713.2023.10206792Scopus ID: 2-s2.0-85171469978OAI: oai:DiVA.org:kth-337882DiVA, id: diva2:1803849
Conference
2023 IEEE International Symposium on Information Theory, ISIT 2023, Taipei, Taiwan, Jun 25 2023 - Jun 30 2023
Note

Part of ISBN 9781665475549

QC 20231010

Available from: 2023-10-10 Created: 2023-10-10 Last updated: 2023-10-10Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Gouverneur, AmauryRodríguez Gálvez, BorjaOechtering, Tobias J.Skoglund, Mikael

Search in DiVA

By author/editor
Gouverneur, AmauryRodríguez Gálvez, BorjaOechtering, Tobias J.Skoglund, Mikael
By organisation
Information Science and Engineering
Probability Theory and StatisticsComputer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 51 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf