Artificial Intelligence (AI) and its workhorse machine learning (ML) can often do more than humans are capeable – no question about that. However, in some situations and with some problems, AI is astonishingly unreliable and, above all, it is impossible to retrace, to understand, to interpret and to explain how and why a result was achieved (try ChatGPT and you will quickly be very disappointed). AI suffers from a lack of robustness and explainability. Above all, however, it lacks common sense (Hausverstand). Sometimes, of course not always, a human-in-the-loop can be helpful to bring conceptual understanding into the machine learning pipeline.
The introduction of AI to areas that impact human life (agrculture, climate, forestry, health, ….) has led to an increased demand for trustworthy AI. Andreas Holzinger is dedicated to the international research community and works together with his group on Human-Centered AI (HCAI), motivated by the desire to improve robustness and explainability to promote safe AI solutions and to support a synergistic approach to harmonize AI with human values, ethical principles and legal requirements. Watch the inaugural lecture here: https://www.youtube.com/watch?v=odFFJIgDElw&t=1096s
A1) Invited Keynote Lectures (selected – last five years):
2023 Keynote on Human-Centered AI to foster Trustworthy AI at the Institute for Pure and Applied Mathematics, 09.01.2023-11.01.2023, University California Los Angeles, USA http://www.ipam.ucla.edu/programs/workshops/explainable-ai-for-the-sciences-towards-novel-insights/
2022 Keynote at the 21st IEEE International Conference on Machine Learning and Applications, Nassau, Commonwealth of Bahamas [https://www.icmla-conference.org/icmla22] [Holzinger-Abstract-ICMLA-2022] [22-12-14-MI-1430-HOLZINGER-ICMLA-keynote]
2022 Inaugural Lecture, Digital Transformation for smart farm and forest operations needs Human-Centered AI, BOKU Vienna, Austria [slides, Youtube]
2022 Keynote at MIE XAI Panel on Causability: Measuring the Quality of Explanations, Nice, France, May, 27, 2022 https://mie2022.org/
2022 Keynote at AAAI Interactive Machine Learning Workshop, Vancouver, CA, https://sites.google.com/view/aaai22-imlw
[Slides, pdf, 6.569 kB]
2021 AI for Good Discovery. Trustworthy AI: Explainability and Robustness for Trustworthy AI, ITU Event, Geneva, CH [youtube]
2021 National Institute of Standards & Technology, US Department of Commerce, Washington (D.C.), US
2021 Explainable AI approaches for debugging and diagnosis, NeurIPS 21, Vancouver, CA https://xai4debugging.github.io/
2021 The next frontier: Artificial Intelligence we can really trust. Keynote at the ECML PKDD International Workshop and Tutorial XKDD
[Paper, pdf, 395kB] [Web of Science]
2021 Explainability and Robustness in Health Intellligence at the 5th International Workshop on Health Intellligence of the 35th AAAI Conference on Artificial Intelligence 2021
2020 From Explainable AI to Human-Centered AI at the 4th International Workshop on interactive adaptive machine learning of the 31st/24th ECML/PKDD 2020
2020 On Human-Centered AI in Medicine at the 20th Mensch & Computer Conference of the Gesellschaft für Informatik, German Informatics Society, M&C 2020 [paper]
2020 Towards Robust machine learning in the medical domain at the 13th International Conference on Biomedical Engineering Systems and Technologies, BIOSTEC 2020
2019 From Machine Learning to Explainable AI and beyond at the 11th International Joint Conference on Computational Intelligence, IJCCI 2019
2018 From Machine Learning to Explainable AI at the IEEE World Symposium on Digital Intelligence for Systems and Machines, DISA 2018 [paper]
2017 Advances and Future Challenges in Machine Learning and Knowledge Extraction at the 7th international conference on Data Science, DATA 2017
2016 Machine Learning for health informatics: recent trends and applications at the 20th Knowledge Engineering Systems Conference, KES 2016
A2) Scientific Community Service – Editorial Positions in Academic Journals (selected last five years):
2023 Co-Editor Special Issue on Human-Centered Artificial Intelligence for One Health. In: Elsevier Artificial Intelligence in Medicine, IF (2021) = 7.011, Q1 32/145 Comptuer Science/Artificial Intelligence [Call for Papers]
2023 Co-Editor Special Issue on Artificial Intelligence for the Life Sciences. In: Elsevier New Biotechnology, IF (2021) 6.490, Q1 9/79 in Biochemical Research Methods, Q1 24/158 in Biotechnology, Rolling issue, [Call for papers] open until 05/2023 [Paper submission here]
2022 Co-Editor Special Issue on AI Ethics and Trust. In: IEEE Intelligent Systems (this is the oldest IEEE periodical in Artificial Intelligence) IF (2021) = 6.744, Q1 Journal, 34/145 in Artificial Intelligence. [IEEE Intelligent Systems]
2021 Co-Editor Special Issue on Advances in Explainable Artificial Intelligence (XAI) and Responsible Artificial Intelligence (RAI). In: Elsevier Information Fusion (INFFUS), IF (2019) = 13.669, Q1, 2/137 in the field “Artificial Intelligence”, 1/108 in the field “Computer Science, Theorie & Methods” (closed)
2021- Associate Editor for Human-Centered AI, explainable AI, medical AI, interactive machine learning, decision support
IEEE Journal of Biomedical & Health Informatics (JBHI), IF(2019)=5.223, Q1 1/27 in the field “Medical Informatics”, 15/156 “Info Systems”, 12/109 “Computer Science Interdisciplinary” (closed)
2020 Co-Editor Special Issue on Explainable Artificial Intelligence (xAI)
Artificial Intelligence (ARTINT), IF (2019) = 6.628, Q1, 14/137 in the field “Artificial Intelligence” (closed)
2018- Editorial Board Member
Artificial Intelligence in Medicine (AIM), IF (2019)=4.383, Q1, 30/137 in “Artificial Intelligence”, 15/87 in “Biomedical Engineering”, 3/27 in “Medical Informactics”
2018- Associate Editor
International Journal of Human-Computer Studies (IJHCS), IF (2019) = 3.163, Q2, 7/22 in “Computer Science, Cybernetics”, Q1, 24/138 in “Multidisciplinary Psychology”, and Q1, 4/16 in “Ergonomics”
2016- Associate Editor
Knowledge and Information Systems (KAIS), IF(2019) = 2.936, Q2, 52/137 in “Artificial Intelligence” and Q2, 57/156 in “Computer Science, Information Systems”
B) Scientific Community Service: Conference Support (selection, in chronological order)
2023 CD-MAKE International IFIP Cross Domain (CD) Conference for Machine Learning & Knowledge Extraction (MAKE)
Conference: https://cd-make.net
Venue: https://www.unisannio.it/
2022 CD-MAKE International IFIP Cross Domain (CD) Conference for Machine Learning & Knowledge Extraction (MAKE)
Conference: https://cd-make.net
Venue: https://informatik.univie.ac.at/en/
2022 HCAI-Lab Symposium Digital Transformation for Smart Farm and Forest Operations
Symposium: https://human-centered.ai/hcai-lab-symposium-digital-transformation-in-smart-farm-and-forest-operations-august-22-2022/
Venue: https://www.fmplus-noe.at/deutsch/immobilien/universitaets-und-forschungszentrum-tulln/
2022 ICLR 2022 -2nd International Joint Conference on Learning & Reasoning in Windsor near London (UK)
Call for Papers: https://ijclr22.doc.ic.ac.uk
Machine Learning Journal track cut-off date: February, June, August 2022
2021 IJCLR 2021 – 1st International Joint Conference on Learning & Reasoning (was planned in Athens, will be held virtually)
Call for Papers: http://lr2020.iit.demokritos.gr/papers/index.html
Deadline: May, 1, 2021,
We call for papers on the following topics: (1) explaining other types of ML models (e.g. random forest, kernel machines, k-means), (2) explanation for other ML tasks (e.g. segmentation, unsupervised learning, reinforcement learning), (3) explaining beyond heatmaps (structured explanations, Q/A and dialog systems, human-in-the-loop), (4) Explaining beyond explaining (e.g., improving ML models and algorithms, verifying Machine Learning, getting insights).
2020 ICML 2020 XXAI Workshop – Extending Explainable AI Beyond Deep Models and Classifiers, July, 18, 2020, Vienna, Austria (will be held virtually)
Call for Papers: http://interpretable-ml.org/icml2020workshop/
Deadline: June, 20, 2020, Submission: https://cmt3.research.microsoft.com/User/Login?ReturnUrl=%2FXXAI2020
We call for papers on the following topics: (1) explaining other types of ML models (e.g. random forest, kernel machines, k-means), (2) explanation for other ML tasks (e.g. segmentation, unsupervised learning, reinforcement learning), (3) explaining beyond heatmaps (structured explanations, Q/A and dialog systems, human-in-the-loop), (4) Explaining beyond explaining (e.g., improving ML models and algorithms, verifying Machine Learning, getting insights).
2020 NeSy – 15th International Workshop on Neural-Symbolic Learning and Reasoning, NeSy’20@IJCLR 2020, September, 9-11, 2020, Athens, Greece
https://sites.google.com/view/nesy20/home
http://lr2020.iit.demokritos.gr/index.html
Deadline: April 15, 2020 (Journal Track Submission 2)
The NeSy workshop series celebrates the integration of connectionist and symbolic thinking, technologies, theories, and techniques in Artificial Intelligence systems, it is the annual gathering of the Neural-Symbolic Learning and Reasoning Association. It is co-located with the 1st International Confrence on Learning & Reasoning IJCLR 2020
2020 IJCAI-PRICAI – 29th International Joint Conference on Artificial Intelligence and the 17th Pacific Rim International Conference on Artificial Intelligence, IJCAI-PRICAI, July, 11-17, 2020, Yokohama, Japan
https://www.ijcai20.org/
For more than a half-century IJCAI is the premier conference bringing together the international AI community to communicate the advances and achievements of artificial intelligence research. PRICAI was initiated in 1990 to create an artificial intelligence conference that would promote collaborative AI research in the Pacific Rim nations. This is the first time that IJCAI and PRICAI have been held jointly. With the current exploding interest in AI and its applications, the joint IJCAI-PRICAI conference will provide an exciting forum to present and hear about cutting-edge research in AI.
2020 AVI – Advanced Visual Interfaces, AVI 2020, June, 9-12, 2020, Island of Ischia, Italy
https://sites.google.com/unisa.it/avi2020/home
Throughout more than two decades, AVI has attracted leading researchers of Human-Computer Interaction (HCI), offering a forum to present and disseminate new technological results, paradigms and visions for HCI and user interfaces. Because of advanced technology and new possibilities for user interaction, AVI has broadened the topics it covers, still keeping its main focus on the conception, design, implementation and evaluation of novel visual interfaces, which is highly relevant for dialogsystems and conversational interfaces needed for explainable AI.
2020 exAI Workshop – “explainable AI” in the context of IFIP CD-MAKE 2020, August 24-28, 2020, University College Dublin
https://human-centered.ai/explainable-ai-2020/
Organized by the Human-centered AI group Graz together with the xAI-Lab at the Alberta Machine Intelligence Institute the workshop is aiming to bring together international experts cross-domain, interested in making machine decisions transparent, interpretable, transparent, reproducible, replicable, re-traceable, re-enactive, comprehensible, explainable – towards ethical-responsible AI/machine learning. The workshop is organized in the context of the IFIP CD-MAKE conference
Deadline: March, 29, 2020
2020 CD-MAKE – International IFIP Cross Domain Conference for Machine Learning & Knowledge Extraction CD-MAKE 2020, August 24 – 28, 2020, University College Dublin, Ireland https://cd-make.net/
CD-MAKE is a joint effort of IFIP TC 5, IFIP TC 12, IFIP WG 8.4, IFIP WG 8.9 and IFIP WG 12.9 and is held at the University College Dublin, Dublin, Ireland in conjunction with
the 15th International Conference on Availability, Reliability and Security ARES 2020
Deadline: March, 29, 2020
2019 11th International Joint Conference on Computational Intelligence (IJCCI 2019), Vienna, 19th September 2019, Keynote Lecturer (Keynote Chair: Marco Dorigo) – 45 min. video available on Vimeo https://vimeo.com/372843062
2019 European Conference on Machine Learning and Knowledge Discovery ECML-PKDD, 23. PKDD; 30. ECML, September 16-20, 2019, Wuerzburg (DE) – Member of Organizing committee of the workshop “Interactive Adaptive Learning (IAL 2019)
2019 2nd Workshop MAKE-Explainable AI, August 26-29, 2019 in the context of the IFIP CD-MAKE 2019 conference
https://hci-kdd.org/make-explainable-artificial-intelligence-2019
2019 IFIP International Cross Domain Conference for Machine Learning & Knowledge Extraction (CD-MAKE), August 26 – 29, Canterbury, Kent, UK in liason with the 14th international Conference on Availability, Reliability and Security (ARES 2018) – Co-Chair and Co-Organizer of the main conference https://cd-make.net
2018 European Conference on Machine Learning and Knowledge Discovery ECML-PKDD, 22. PKDD; 29. ECML, September 10, 2018, Dublin (IE), [ECML Portal] – Member of Organizing committee of the workshop “Interactive Adaptive Learning (IAL 2018), https://www.ies.uni-kassel.de/p/ial2018
2018 MAKE-Explainable AI, August, 30, 2018 Workshop on explainable artificial intelligence with Randy GOEBEL as keynote speaker, Co-Chair and Co-Organizer https://cd-make.net/special-sessions/make-explainable-ai/
2018 ACM SIGCHI International Conference on Advanced Visual Interfaces (AVI), May, 29 – June, 1, 2018, Riva del Sole, Grosseto, Long-Paper Co-Chair (together with Giuliana Vitiello). Since 1992, AVI has has attracted leading researchers of Human-Computer Interaction (HCI) from all over the world, offering a forum to present and disseminate new technological results, paradigms and visions, https://sites.google.com/dis.uniroma1.it/avi2018
2017 International IFIP Cross Domain Conference for Machine Learning & Knowledge Extraction (CD-MAKE), August 29 – September, 2, Reggio di Calabria, Italy in liason with the 12th international Conference on Availability, Reliability and Security (ARES 2017) – Co-Chair and Co-Organizer, https://cd-make.net
2017 European Conference on Machine Learning and Knowledge Discovery ECML-PKDD, 21. PKDD; 28. ECML, September 18-22, 2017, Skopje, Macedonia, [ECML Portal] – Member Program Committee, Journal-Track Co-Chair, http://ecmlpkdd2017.ijs.si
2017 8th International Conference on Information Technology in Bio- and Medical Informatics ITBAM 2017, August 28-31, 2017, Lyon, France – in liason with 28th International Conference on Database and Expert Systems Applications (DEXA) – Program Co-Chair, http://www.dexa.org
2017 10th International Conferences on Brain Informatics BI 2017, November 16-18, 2017 in Beijing, China, PC member,
http://bii.ia.ac.cn/bi-2017/
2017 8th EPIA Conference on Artificial Intelligence, 5th -8th September, Porto, PC member,
https://web.fe.up.pt/~epia2017
2016 7th International Conference on Information Technology in Bio- and Medical Informatics – ITBAM 2016, September 5-8, Porto, Portugal – in liason with 27th International Conference on Database and Expert Systems Applications (DEXA) – Program Co-Chair, http://www.dexa.org/previous/dexa2016/itbam2016.html
2016 CD-ARES – Availability, Reliability, and Security in Information Systems – IFIP WG 8.4, 8.9, TC 5 International Cross-Domain Conference, Salzburg, August 31 – September, 2, Austria, PC-co-chair, http://dblp.uni-trier.de/db/conf/IEEEares/cd-ares2016.html
2016 Workshop PAML 2016 – Privacy Aware Machine Learning in the context of CD-ARES, Salzburg, September, 1, 2016
http://hci-kdd.org/privacy-aware-machine-learning-for-data-science
2015 14th IEEE International Conference on Machine Learning and Applications, ICMLA 2015, Miami, Florida, USA, December 9-11, 2015, Program Co-Chair [AMLA – Association for Machine Learning and Applications]
http://dblp.uni-trier.de/db/conf/icmla/icmla2015.html
2015 6th International Conference on Information Technology in Bio- and Medical Informatics – ITBAM 2015, September 3-4, Valencia, Spain – in liason with 26th International Conference on Database and Expert Systems Applications (DEXA) – Program Co-Chair, [http://dblp.uni-trier.de/db/conf/itbam/itbam2015.html]
2015 DATA 2015 – 4th International Conference on Data Management Technologies and Applications, Colmar, Alsace, France, 20-22 July, Program Co-Chair [http://dblp.uni-trier.de/db/conf/data/data2015.html]
2014 DATA 2014 – 3rd International Conference on Data Management Technologies and Applications, Vienna, Austria, 29-31 August, General Chair, [http://dblp.uni-trier.de/db/conf/data/data2014.html]
Last updated: 18.01.2020
C) Scientific Community Service: Reviewing Activities (selection):
Elsevier Informtion Fusion (INFFUS). IF(2018)=10,716
The journal is intended to present within a single forum all of the developments in the field of multi-sensor, multi-source, multi-process information fusion and thereby promote the synergism among the many disciplines that are contributing to its growth.
https://www.journals.elsevier.com/information-fusion
https://dblp.uni-trier.de/db/journals/inffus/
Springer Nature Machine Learning (MACH). IF(2015)=1,719
Machine Learning is an international forum for research on computational approaches to learning. The journal publishes articles reporting substantive results on a wide range of learning methods applied to a variety of learning problems.
http://www.springer.com/computer/ai/journal/10994
https://www.editorialmanager.com/mach/default.aspx
ACM Computing Surveys (CSUR). IF(2015)=5,243
CSUR publishes tutorials and survey papers that give guided tours through the literature and explain topics to those who seek to learn the basics of areas outside their specialties.
http://csur.acm.org
https://mc.manuscriptcentral.com/csur
IEEE Transactions on Human-Machine Systems (THMS). IF(2015)=1,8
THMS covers human systems and human organizational interactions including cognitive ergonomics, system test and evaluation, and human information processing concerns in systems and organizations. IEEE Transactions on Human-Machine Systems was launched on January 1, 2013 to replace the human-machine systems sections of IEEE Transactions on Systems, Man and Cybernetics.
http://www.ieeesmc.org/publications/transactions-on-human-machine-systems
https://mc.manuscriptcentral.com/thms
Elsevier Computer Methods and Programs in Biomedicine (CMPB). IF(2015)=1,862
Computer Methods and Programs in Biomedicine covers computing methodology and software systems derived from computing science for implementation in all aspects of biomedical research and medical practice.
https://www.journals.elsevier.com/computer-methods-and-programs-in-biomedicine
https://www.evise.com/profile/#/CMPB/login
Oxford Journal of the American Medical Informatics Association (JAMIA). IF(2015)=3,428
JAMIA is AMIA’s premier journal for biomedical and health informatics, including articles in clinical care, clinical research, translational science, implementation science, imaging, education, consumer health, public health, and policy. JAMIA’s articles describe innovative informatics research and systems that help to advance biomedical science and to promote health.
https://academic.oup.com/jamia
https://mc.manuscriptcentral.com/jamia
Elsevier Artificial Intelligence in Medicine (AIME). IF(2015)=2,142
Artificial Intelligence in Medicine publishes original articles from a wide variety of interdisciplinary perspectives concerning the theory and practice of artificial intelligence (AI) in medicine, human biology, and health care. Particular attention is given to AI-based clinical decision making and computational intelligence.
https://www.journals.elsevier.com/artificial-intelligence-in-medicine
Elsevier International Journal of Medical Informatics (IJMI). IF(2015)=2,363
The Journal provides an international medium for dissemination of original results and interpretative reviews concerning the field of medical informatics, including information systems, medical decision support systems using heuristic, algorithmic and/or statistical methods, artificial intelligence, etc.
New: The journal offers AudioSlides, webcast-style presentations that are shown next to published articles on Science Direct and can be viewed for free: http://www.elsevier.com/audioslides
https://www.journals.elsevier.com/international-journal-of-medical-informatics
https://ees.elsevier.com/ijmi
Springer Nature Neural Computing and Applications (NCAA). IF(2015)=1,492
The journal is in the field of practical applications of neural computing and related techniques such as genetic algorithms, fuzzy logic and neuro-fuzzy systems, including contributions in the area of applicable neural networks theory, supervised and unsupervised learning methods, algorithms, architectures, performance measures, applied statistics, software simulations, hardware implementations, benchmarks, system engineering and integration and case histories of innovative applications.
http://www.springer.com/computer/ai/journal/521
http://www.editorialmanager.com/ncaa/default.aspx
http://dblp.uni-trier.de/db/journals/nca
Oxford Bioinfomatics. IF(2015)=5,766
The leading journal in its field, Bioinformatics publishes the highest quality scientific papers and review articles of interest to academic and industrial researchers. Its main focus is on new developments in genome bioinformatics and computational biology. Two distinct sections within the journal – Discovery Notes and Application Notes – focus on shorter papers; the former reporting biologically interesting discoveries using computational methods, the latter exploring the applications used for experiments.
https://academic.oup.com/bioinformatics
https://mc.manuscriptcentral.com/bioinformatics
http://dblp.uni-trier.de/db/journals/bioinformatics
Last updated: 20.09.2019