Masked Autoencoder Pretraining for Event Classification in Elite Soccer

Yannick Rudolph; Ulf Brefeld

doi:10.1007/978-3-031-53833-9_3

Masked Autoencoder Pretraining for Event Classification in Elite Soccer

Yannick Rudolph^*
, Ulf Brefeld

^*Korrespondierende/r Autor/-in für diese Arbeit

Professur für Wirtschaftsinformatik, insbesondere Machine Learning

Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › Begutachtung

Abstract

We show that pretraining transformer models improves the performance on supervised classification of tracking data from elite soccer. Specifically, we propose a novel self-supervised masked autoencoder for multiagent trajectories. In contrast to related work, our approach is significantly simpler, has no necessity for handcrafted features and inherently allows for permutation invariance in downstream tasks.

Originalsprache	Englisch
Titel	Machine Learning and Data Mining for Sports Analytics : 10th International Workshop, MLSA 2023, Revised Selected Papers
Redakteure/-innen	Ulf Brefeld, Jesse Davis, Jan Van Haaren, Albrecht Zimmermann
Seitenumfang	12
Erscheinungsort	Cham
Herausgeber (Verlag)	Springer Nature Switzerland AG
Erscheinungsdatum	26.02.2024
Seiten	24-35
ISBN (Print)	978-3-031-53832-2
ISBN (elektronisch)	978-3-031-53833-9
DOIs	https://doi.org/10.1007/978-3-031-53833-9_3
Publikationsstatus	Erschienen - 26.02.2024
Veranstaltung	10th International Workshop on Machine Learning and Data Mining for Sports Analytics - MLSA 2023 - Turin, Italien Dauer: 18.09.2023 → 18.09.2023 Konferenznummer: 10 https://dtai.cs.kuleuven.be/events/MLSA23/ http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=173575&copyownerid=49896

Bibliographische Notiz

Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.

Fachgebiete und Schlagwörter

Informatik
Wirtschaftsinformatik

Zugriff auf Dokument

10.1007/978-3-031-53833-9_3

1 Zeitschriftenaufsätze

Masked autoencoder for multiagent trajectories
Rudolph, Y. & Brefeld, U., 02.2025, in: Machine Learning. 114, 2, 18 S., 44.
Publikation: Beiträge in Zeitschriften › Zeitschriftenaufsätze › Forschung › Begutachtung

Open Access
1 Zitat (Scopus)

1 Vorträge in anderen Veranstaltungen

Masked Autoencoder Pretraining for Event Classification in Elite Soccer
Rudolph, Y. (Sprecher*in) & Brefeld, U. (Ko-Autor*in)
18.09.2023
Aktivität: Vorträge und Gastvorlesungen › Vorträge in anderen Veranstaltungen › Forschung

Dieses zitieren

Rudolph, Y., & Brefeld, U. (2024). Masked Autoencoder Pretraining for Event Classification in Elite Soccer. in U. Brefeld, J. Davis, J. Van Haaren, & A. Zimmermann (Hrsg.), Machine Learning and Data Mining for Sports Analytics: 10th International Workshop, MLSA 2023, Revised Selected Papers (S. 24-35). (Communications in Computer and Information Science; Band 2035). Springer Nature Switzerland AG. https://doi.org/10.1007/978-3-031-53833-9_3

Rudolph, Yannick ; Brefeld, Ulf. / Masked Autoencoder Pretraining for Event Classification in Elite Soccer. Machine Learning and Data Mining for Sports Analytics: 10th International Workshop, MLSA 2023, Revised Selected Papers. Hrsg. / Ulf Brefeld ; Jesse Davis ; Jan Van Haaren ; Albrecht Zimmermann. Cham : Springer Nature Switzerland AG, 2024. S. 24-35 (Communications in Computer and Information Science).

@inbook{0ca682cc4633469e8d5e809ba430275d,

title = "Masked Autoencoder Pretraining for Event Classification in Elite Soccer",

abstract = "We show that pretraining transformer models improves the performance on supervised classification of tracking data from elite soccer. Specifically, we propose a novel self-supervised masked autoencoder for multiagent trajectories. In contrast to related work, our approach is significantly simpler, has no necessity for handcrafted features and inherently allows for permutation invariance in downstream tasks.",

keywords = "Factorized transformer architecture, Masked autoencoder, Multiagent trajectories, Self-supervised learning, Soccer, Tracking data, Informatics, Business informatics",

author = "Yannick Rudolph and Ulf Brefeld",

note = "Publisher Copyright: {\textcopyright} The Author(s), under exclusive license to Springer Nature Switzerland AG 2024.; 10th International Workshop on Machine Learning and Data Mining for Sports Analytics - MLSA 2023, MLSA 2023 ; Conference date: 18-09-2023 Through 18-09-2023",

year = "2024",

month = feb,

day = "26",

doi = "10.1007/978-3-031-53833-9\_3",

language = "English",

isbn = "978-3-031-53832-2",

series = "Communications in Computer and Information Science",

publisher = "Springer Nature Switzerland AG",

pages = "24--35",

editor = "Ulf Brefeld and Jesse Davis and \{Van Haaren\}, Jan and Albrecht Zimmermann",

booktitle = "Machine Learning and Data Mining for Sports Analytics",

address = "Switzerland",

url = "https://dtai.cs.kuleuven.be/events/MLSA23/ , http://www.wikicfp.com/cfp/servlet/event.showcfp?eventid=173575\&copyownerid=49896",

}

Rudolph, Y & Brefeld, U 2024, Masked Autoencoder Pretraining for Event Classification in Elite Soccer. in U Brefeld, J Davis, J Van Haaren & A Zimmermann (Hrsg.), Machine Learning and Data Mining for Sports Analytics: 10th International Workshop, MLSA 2023, Revised Selected Papers. Communications in Computer and Information Science, Bd. 2035, Springer Nature Switzerland AG, Cham, S. 24-35, 10th International Workshop on Machine Learning and Data Mining for Sports Analytics - MLSA 2023, Turin, Italien, 18.09.23. https://doi.org/10.1007/978-3-031-53833-9_3

Masked Autoencoder Pretraining for Event Classification in Elite Soccer. / Rudolph, Yannick ; Brefeld, Ulf.
Machine Learning and Data Mining for Sports Analytics: 10th International Workshop, MLSA 2023, Revised Selected Papers. Hrsg. / Ulf Brefeld; Jesse Davis; Jan Van Haaren; Albrecht Zimmermann. Cham: Springer Nature Switzerland AG, 2024. S. 24-35 (Communications in Computer and Information Science; Band 2035).

Publikation: Beiträge in Sammelwerken › Aufsätze in Konferenzbänden › Forschung › Begutachtung

TY - CHAP

T1 - Masked Autoencoder Pretraining for Event Classification in Elite Soccer

AU - Rudolph, Yannick

AU - Brefeld, Ulf

N1 - Conference code: 10

PY - 2024/2/26

Y1 - 2024/2/26

N2 - We show that pretraining transformer models improves the performance on supervised classification of tracking data from elite soccer. Specifically, we propose a novel self-supervised masked autoencoder for multiagent trajectories. In contrast to related work, our approach is significantly simpler, has no necessity for handcrafted features and inherently allows for permutation invariance in downstream tasks.

AB - We show that pretraining transformer models improves the performance on supervised classification of tracking data from elite soccer. Specifically, we propose a novel self-supervised masked autoencoder for multiagent trajectories. In contrast to related work, our approach is significantly simpler, has no necessity for handcrafted features and inherently allows for permutation invariance in downstream tasks.

KW - Factorized transformer architecture

KW - Masked autoencoder

KW - Multiagent trajectories

KW - Self-supervised learning

KW - Soccer

KW - Tracking data

KW - Informatics

KW - Business informatics

UR - https://www.scopus.com/pages/publications/85187650562

UR - https://www.mendeley.com/catalogue/df720300-8c0a-37b1-a340-cb810b405c19/

U2 - 10.1007/978-3-031-53833-9_3

DO - 10.1007/978-3-031-53833-9_3

M3 - Article in conference proceedings

AN - SCOPUS:85187650562

SN - 978-3-031-53832-2

T3 - Communications in Computer and Information Science

SP - 24

EP - 35

BT - Machine Learning and Data Mining for Sports Analytics

A2 - Brefeld, Ulf

A2 - Davis, Jesse

A2 - Van Haaren, Jan

A2 - Zimmermann, Albrecht

PB - Springer Nature Switzerland AG

CY - Cham

T2 - 10th International Workshop on Machine Learning and Data Mining for Sports Analytics - MLSA 2023

Y2 - 18 September 2023 through 18 September 2023

ER -

Rudolph Y , Brefeld U. Masked Autoencoder Pretraining for Event Classification in Elite Soccer. in Brefeld U, Davis J, Van Haaren J, Zimmermann A, Hrsg., Machine Learning and Data Mining for Sports Analytics: 10th International Workshop, MLSA 2023, Revised Selected Papers. Cham: Springer Nature Switzerland AG. 2024. S. 24-35. (Communications in Computer and Information Science). doi: 10.1007/978-3-031-53833-9_3

Masked Autoencoder Pretraining for Event Classification in Elite Soccer

Abstract

Bibliographische Notiz

Fachgebiete und Schlagwörter

Zugriff auf Dokument

Fingerprint

Publikationen

Masked autoencoder for multiagent trajectories

Aktivitäten

Masked Autoencoder Pretraining for Event Classification in Elite Soccer

Dieses zitieren