TY - JOUR A1 - Knigge, Michel T1 - Use of evidence to promote inclusive education development commentary on Mel Ainscow. Promoting inclusion and equity in education BT - Lessons from international experiences JF - Nordic Journal of Studies in Educational Policy N2 - In his essay, Mel Ainscow looks at inclusion and equity from an international perspective and makes suggestions on how to develop inclusive education in a ‘whole-system approach’. After discussing different conceptions of inclusion and equity, he describes international policies which address them. From this international macro-level, Ainscow zooms in to the meso-level of the school and its immediate environment, defining dimensions to be considered for an inclusive school development. One of these dimensions is the ‘use of evidence’. In my comment, I want to focus on this dimension and discuss its scope and the potential to apply it in inclusive education development. As a first and important precondition, Ainscow explains that different circumstances lead to different linguistic uses of the term ‘inclusive education’. Thus, the term ‘inclusive education’ does not refer to an identical set of objectives across countries, and neither does the term ‘equity’. KW - evidence KW - inclusion KW - education KW - evaluation KW - practice Y1 - 2020 U6 - https://doi.org/10.1080/20020317.2020.1730093 SN - 2002-0317 VL - 6 IS - 1 SP - 21 EP - 24 PB - Taylor & Francis Group CY - London ER - TY - JOUR A1 - Waitelonis, Jörg A1 - Jürges, Henrik A1 - Sack, Harald T1 - Remixing entity linking evaluation datasets for focused benchmarking JF - Semantic Web N2 - In recent years, named entity linking (NEL) tools were primarily developed in terms of a general approach, whereas today numerous tools are focusing on specific domains such as e.g. the mapping of persons and organizations only, or the annotation of locations or events in microposts. However, the available benchmark datasets necessary for the evaluation of NEL tools do not reflect this focalizing trend. We have analyzed the evaluation process applied in the NEL benchmarking framework GERBIL [in: Proceedings of the 24th International Conference on World Wide Web (WWW’15), International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 2015, pp. 1133–1143, Semantic Web 9(5) (2018), 605–625] and all its benchmark datasets. Based on these insights we have extended the GERBIL framework to enable a more fine grained evaluation and in depth analysis of the available benchmark datasets with respect to different emphases. This paper presents the implementation of an adaptive filter for arbitrary entities and customized benchmark creation as well as the automated determination of typical NEL benchmark dataset properties, such as the extent of content-related ambiguity and diversity. These properties are integrated on different levels, which also enables to tailor customized new datasets out of the existing ones by remixing documents based on desired emphases. Besides a new system library to enrich provided NIF [in: International Semantic Web Conference (ISWC’13), Lecture Notes in Computer Science, Vol. 8219, Springer, Berlin, Heidelberg, 2013, pp. 98–113] datasets with statistical information, best practices for dataset remixing are presented, and an in depth analysis of the performance of entity linking systems on special focus datasets is presented. KW - Entity Linking KW - GERBIL KW - evaluation KW - benchmark Y1 - 2019 U6 - https://doi.org/10.3233/SW-180334 SN - 1570-0844 SN - 2210-4968 VL - 10 IS - 2 SP - 385 EP - 412 PB - IOS Press CY - Amsterdam ER - TY - GEN A1 - Ghahremani, Sona A1 - Giese, Holger T1 - Performance evaluation for self-healing systems BT - Current Practice & Open Issues T2 - 2019 IEEE 4th International Workshops on Foundations and Applications of Self* Systems (FAS*W) N2 - Evaluating the performance of self-adaptive systems (SAS) is challenging due to their complexity and interaction with the often highly dynamic environment. In the context of self-healing systems (SHS), employing simulators has been shown to be the most dominant means for performance evaluation. Simulating a SHS also requires realistic fault injection scenarios. We study the state of the practice for evaluating the performance of SHS by means of a systematic literature review. We present the current practice and point out that a more thorough and careful treatment in evaluating the performance of SHS is required. KW - self-healing KW - failure profile KW - evaluation KW - simulator KW - performance Y1 - 2019 SN - 978-1-7281-2406-3 U6 - https://doi.org/10.1109/FAS-W.2019.00039 SP - 116 EP - 119 PB - IEEE CY - New York ER - TY - CHAP A1 - Rojahn, Marcel A1 - Gronau, Norbert ED - Bui, Tung X. T1 - Openness indicators for the evaluation of digital platforms between the launch and maturity phase T2 - Proceedings of the 57th Annual Hawaii International Conference on System Sciences N2 - In recent years, the evaluation of digital platforms has become an important focus in the field of information systems science. The identification of influential indicators that drive changes in digital platforms, specifically those related to openness, is still an unresolved issue. This paper addresses the challenge of identifying measurable indicators and characterizing the transition from launch to maturity in digital platforms. It proposes a systematic analytical approach to identify relevant openness indicators for evaluation purposes. The main contributions of this study are the following (1) the development of a comprehensive procedure for analyzing indicators, (2) the categorization of indicators as evaluation metrics within a multidimensional grid-box model, (3) the selection and evaluation of relevant indicators, (4) the identification and assessment of digital platform architectures during the launch-to-maturity transition, and (5) the evaluation of the applicability of the conceptualization and design process for digital platform evaluation. KW - federated industrial platform ecosystems KW - technologies KW - business models KW - data-driven artifacts KW - design-science research KW - digital platform openness KW - evaluation KW - morphological analysis Y1 - 2024 SN - 978-0-99813-317-1 SP - 4516 EP - 4525 PB - Department of IT Management Shidler College of Business University of Hawaii CY - Honolulu, HI ER - TY - JOUR A1 - Sallen, Jeffrey A1 - Hemming, Karen A1 - Richartz, Alfred T1 - Facilitating dual careers by improving resistance to chronic stress BT - effects of an intervention programme for elite student athletes JF - European journal of sport science : official journal of the European College of Sport Science N2 - The starting point of this contribution is the potential risk to health and performance from the combination of elite sporting careers with the pursuit of education. In European sport science and politics, structural measures to promote dual careers in elite sports have been discussed increasingly of late. In addition to organisational measures, there are calls for educational-psychological intervention programmes supporting the successful management of dual careers at the individual level. This paper presents an appropriate intervention programme and its evaluation: stress-resistance training for elite athletes (SRT-EA). It comprises 10 units, each lasting 90 minutes. It is intended for athletes and aims to improve their resistance to chronic stress. The evaluation was carried out in a quasi-experimental design, with three points of measurement (baseline, immediately after, and three months after) and two non-randomised groups: an intervention group (n=128) and an untreated control group (n=117). Participants were between 13 and 20 years of age (53.5% male) and represented various Olympic sports. Outcome variables were assessed with questionnaires. Significant short- and mid-term intervention effects were explored. The intervention increased stress-related knowledge, general self-efficacy, and stress sensitivity. Chronic stress level, stress symptoms, and stress reactivity were reduced. In line with the intention of the intervention, the results showed short- and mid-term, small to medium-sized effects. Accordingly, separate measurements at the end of the intervention and three months later showed mostly positive subjective experiences. Thus, the results reinforce the hope that educational-psychological stress-management interventions can support dual careers. KW - Chronic stress KW - stress-resistance KW - elite athletes KW - intervention KW - evaluation Y1 - 2017 U6 - https://doi.org/10.1080/17461391.2017.1407363 SN - 1746-1391 SN - 1536-7290 VL - 18 IS - 1 SP - 112 EP - 122 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - CHAP A1 - Grum, Marcus A1 - Klippert, Monika A1 - Albers, Albert A1 - Gronau, Norbert A1 - Thim, Christof T1 - Examining the quality of knowledge transfers BT - the draft of an empirical research T2 - Proceedings of the Design Society N2 - Already successfully used products or designs, past projects or our own experiences can be the basis for the development of new products. As reference products or existing knowledge, it is reused in the development process and across generations of products. Since further, products are developed in cooperation, the development of new product generations is characterized by knowledge-intensive processes in which information and knowledge are exchanged between different kinds of knowledge carriers. The particular knowledge transfer here describes the identification of knowledge, its transmission from the knowledge carrier to the knowledge receiver, and its application by the knowledge receiver, which includes embodied knowledge of physical products. Initial empirical findings of the quantitative effects regarding the speed of knowledge transfers already have been examined. However, the factors influencing the quality of knowledge transfer to increase the efficiency and effectiveness of knowledge transfer in product development have not yet been examined empirically. Therefore, this paper prepares an experimental setting for the empirical investigation of the quality of knowledge transfers. KW - knowledge management KW - new product development KW - evaluation Y1 - 2021 U6 - https://doi.org/10.1017/pds.2021.404 SN - 2732-527X VL - 1 SP - 1431 EP - 1440 PB - Cambridge University Press CY - Cambridge ER - TY - JOUR A1 - Albert, Justin Amadeus A1 - Owolabi, Victor A1 - Gebel, Arnd A1 - Brahms, Clemens Markus A1 - Granacher, Urs A1 - Arnrich, Bert T1 - Evaluation of the Pose Tracking Performance of the Azure Kinect and Kinect v2 for Gait Analysis in Comparison with a Gold Standard BT - A Pilot Study JF - Sensors N2 - Gait analysis is an important tool for the early detection of neurological diseases and for the assessment of risk of falling in elderly people. The availability of low-cost camera hardware on the market today and recent advances in Machine Learning enable a wide range of clinical and health-related applications, such as patient monitoring or exercise recognition at home. In this study, we evaluated the motion tracking performance of the latest generation of the Microsoft Kinect camera, Azure Kinect, compared to its predecessor Kinect v2 in terms of treadmill walking using a gold standard Vicon multi-camera motion capturing system and the 39 marker Plug-in Gait model. Five young and healthy subjects walked on a treadmill at three different velocities while data were recorded simultaneously with all three camera systems. An easy-to-administer camera calibration method developed here was used to spatially align the 3D skeleton data from both Kinect cameras and the Vicon system. With this calibration, the spatial agreement of joint positions between the two Kinect cameras and the reference system was evaluated. In addition, we compared the accuracy of certain spatio-temporal gait parameters, i.e., step length, step time, step width, and stride time calculated from the Kinect data, with the gold standard system. Our results showed that the improved hardware and the motion tracking algorithm of the Azure Kinect camera led to a significantly higher accuracy of the spatial gait parameters than the predecessor Kinect v2, while no significant differences were found between the temporal parameters. Furthermore, we explain in detail how this experimental setup could be used to continuously monitor the progress during gait rehabilitation in older people. KW - motion capture KW - evaluation KW - human motion KW - RGB-D cameras KW - digital health Y1 - 2020 U6 - https://doi.org/10.3390/s20185104 SN - 1424-8220 VL - 20 IS - 18 PB - MDPI CY - Basel ER - TY - JOUR A1 - Ghahremani, Sona A1 - Giese, Holger T1 - Evaluation of self-healing systems BT - An analysis of the state-of-the-art and required improvements JF - Computers N2 - Evaluating the performance of self-adaptive systems is challenging due to their interactions with often highly dynamic environments. In the specific case of self-healing systems, the performance evaluations of self-healing approaches and their parameter tuning rely on the considered characteristics of failure occurrences and the resulting interactions with the self-healing actions. In this paper, we first study the state-of-the-art for evaluating the performances of self-healing systems by means of a systematic literature review. We provide a classification of different input types for such systems and analyse the limitations of each input type. A main finding is that the employed inputs are often not sophisticated regarding the considered characteristics for failure occurrences. To further study the impact of the identified limitations, we present experiments demonstrating that wrong assumptions regarding the characteristics of the failure occurrences can result in large performance prediction errors, disadvantageous design-time decisions concerning the selection of alternative self-healing approaches, and disadvantageous deployment-time decisions concerning parameter tuning. Furthermore, the experiments indicate that employing multiple alternative input characteristics can help with reducing the risk of premature disadvantageous design-time decisions. KW - self-healing KW - failure model KW - performance KW - simulation KW - evaluation Y1 - 2020 U6 - https://doi.org/10.3390/computers9010016 SN - 2073-431X VL - 9 IS - 1 PB - MDPI CY - Basel ER - TY - JOUR A1 - Wilson, Charlie A1 - Guivarch, Céline A1 - Kriegler, Elmar A1 - van Ruijven, Bas A1 - van Vuuren, Detlef P. A1 - Krey, Volker A1 - Schwanitz, Valeria Jana A1 - Thompson, Erica L. T1 - Evaluating process-based integrated assessment models of climate change mitigation JF - Climatic change N2 - Process-based integrated assessment models (IAMs) project long-term transformation pathways in energy and land-use systems under what-if assumptions. IAM evaluation is necessary to improve the models’ usefulness as scientific tools applicable in the complex and contested domain of climate change mitigation. We contribute the first comprehensive synthesis of process-based IAM evaluation research, drawing on a wide range of examples across six different evaluation methods including historical simulations, stylised facts, and model diagnostics. For each evaluation method, we identify progress and milestones to date, and draw out lessons learnt as well as challenges remaining. We find that each evaluation method has distinctive strengths, as well as constraints on its application. We use these insights to propose a systematic evaluation framework combining multiple methods to establish the appropriateness, interpretability, credibility, and relevance of process-based IAMs as useful scientific tools for informing climate policy. We also set out a programme of evaluation research to be mainstreamed both within and outside the IAM community. KW - process-based integrated assessment model KW - IAM KW - evaluation KW - climate mitigation Y1 - 2021 U6 - https://doi.org/10.1007/s10584-021-03099-9 SN - 0165-0009 SN - 1573-1480 VL - 166 IS - 1-2 PB - Springer Science + Business Media B.V. CY - Dordrecht ER - TY - THES A1 - Ullrich, André T1 - Eigenschaften wandlungsfähiger Systeme T1 - Characteristics of changeable systems BT - Erarbeitung eines Indikatorsystems BT - development of an indicator system N2 - Wandlungsfähigkeit beschreibt die Fähigkeit eines Systems, proaktiv oder reaktiv Maßnahmen für die Modifikation seiner Eigenschaften schnell und effizient zu entwickeln, umzusetzen und anzuwenden sowie sich proaktiv darauf vorzubereiten, inaktiv zu sein und passiv Einwirkungen aus der Umwelt zu tolerieren. Die Eigenschaften wandlungsfähiger Systeme werden häufig als Indikatoren (z.B. Modularität, Wissen) verwendet. Dabei existiert eine Vielzahl potenzieller Indikatoren, deren jeweilige Relevanz jedoch ungeklärt ist. Hier setzt die Zielstellung der vorliegenden Arbeit an. Das Erkenntnisziel ist die Erklärung der Wandlungsfähigkeit sozio-technischer Systeme. Zu diesem Zweck wird ein Erklärungsmodell der indikatorbasierten Wandlungsfähigkeit erstellt, das zum Nachweis von Wandlungsfähigkeit, zur Bewertung dieser sowie zur Systemanalyse genutzt werden kann. Weiterhin wird exemplarisch eine positive Korrelation von Wandlungsfähigkeit und Schnelligkeit sowie Effizienz bei Veränderungsprojekten nachgewiesen. N2 - Change capability describes the ability of a system to proactively or reactively develop, implement, and apply measures for the modification of its properties quickly and efficiently, as well as be proactively prepared to be inactive and passively tolerate environmental impacts. The properties of changeable systems are often used as indicators (e.g. modularity, knowledge) of change capability. Thus, diverse potential indicators exist. However, there is no reliable evidence of the relevance of any one in particular. This is exactly where the goal of this thesis sets in. The goal is the explanation of socio-technical systems’ change capability. For this purpose, an explanatory model of the indicator-based change capability is developed, that enables (1) empirical evidence of change capability, (2) evaluation of change capability, and (3) can be used for system analysis. Furthermore, an exemplary proof of a positive correlation between a system's high change capability and its high velocity and efficiency in implementing change projects is identified. KW - Bewertung KW - Systemanalyse KW - Wandlungsfähigkeit KW - change capability KW - evaluation KW - system analysis Y1 - 2018 SN - 978-3-95545-265-0 PB - GITO CY - Berlin ER - TY - GEN A1 - Bender, Benedict A1 - Grum, Marcus A1 - Gronau, Norbert A1 - Alfa, Attahiru A1 - Maharaj, B. T. T1 - Design of a worldwide simulation system for distributed cyber-physical production networks T2 - 2019 IEEE International Conference on Engineering, Technology and Innovation (ICE/ITMC) N2 - Modern production infrastructures of globally operating companies usually consist of multiple distributed production sites. While the organization of individual sites consisting of Industry 4.0 components itself is demanding, new questions regarding the organization and allocation of resources emerge considering the total production network. In an attempt to face the challenge of efficient distribution and processing both within and across sites, we aim to provide a hybrid simulation approach as a first step towards optimization. Using hybrid simulation allows us to include real and simulated concepts and thereby benchmark different approaches with reasonable effort. A simulation concept is conceptualized and demonstrated qualitatively using a global multi-site example. KW - production networks KW - geographical distribution KW - task realization strategies KW - Industry 4.0 KW - simulation KW - evaluation Y1 - 2019 SN - 978-1-7281-3401-7 SN - 978-1-7281-3402-4 U6 - https://doi.org/10.1109/ICE.2019.8792609 SN - 2334-315X PB - IEEE CY - New York ER - TY - JOUR A1 - Klatt, Stefanie A1 - Noel, Benjamin A1 - Musculus, Lisa A1 - Werner, Karsten A1 - Laborde, Sylvain A1 - Lopes, Mariana Calabria A1 - Greco, Pablo J. A1 - Memmert, Daniel A1 - Raab, Markus T1 - Creative and Intuitive Decision-Making Processes: A Comparison of Brazilian and German Soccer Coaches and Players JF - Research Quarterly for Exercise and Sport N2 - Purpose: The concepts of creativity and intuition have been well studied in isolation, but less is known about their distinctive contributions to option generation in decision making. Method: We examined the relation between creative and intuitive decision making in two studies-one involving coaches and one involving soccer players-using video footage of real soccer matches. Additionally, we analyzed whether this relation is culture generic or culture specific by conducting matched cross-cultural studies in a European and a South American country. Results: In Study 1, results indicate a conceptual overlap of creativity and intuition for Brazilian and German soccer coaches. Furthermore, coaches did not differ in their evaluation of creative and intuitive actions of players of both cultures. In Study 2, we found that for both subsamples the total number of generated options was positively correlated with the quality of the first and the final option and that the quality of players' first (intuitive) option was higher than that of options generated later. Moreover, results indicate a positive correlation between a player's creativity score and the quality of the first generated option for the whole sample. Conclusion: Overall, our findings provide meaningful information regarding athletes' and coaches' option-generation processes in decision making in complex team sports. KW - Choice KW - cognitive process KW - evaluation KW - soccer Y1 - 2019 U6 - https://doi.org/10.1080/02701367.2019.1642994 SN - 0270-1367 SN - 2168-3824 VL - 90 IS - 4 SP - 651 EP - 665 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - GEN A1 - Bruechner, Dominik A1 - Renz, Jan A1 - Klingbeil, Mandy T1 - Creating a Framework for User-Centered Development and Improvement of Digital Education T2 - Scale N2 - We investigate how the technology acceptance and learning experience of the digital education platform HPI Schul-Cloud (HPI School Cloud) for German secondary school teachers can be improved by proposing a user-centered research and development framework. We highlight the importance of developing digital learning technologies in a user-centered way to take differences in the requirements of educators and students into account. We suggest applying qualitative and quantitative methods to build a solid understanding of a learning platform's users, their needs, requirements, and their context of use. After concept development and idea generation of features and areas of opportunity based on the user research, we emphasize on the application of a multi-attribute utility analysis decision-making framework to prioritize ideas rationally, taking results of user research into account. Afterward, we recommend applying the principle build-learn-iterate to build prototypes in different resolutions while learning from user tests and improving the selected opportunities. Last but not least, we propose an approach for continuous short- and long-term user experience controlling and monitoring, extending existing web- and learning analytics metrics. KW - learning platform KW - user experience KW - evaluation KW - HPI Schul-Cloud KW - user research framework KW - user-centered design Y1 - 2019 SN - 978-1-4503-6804-9 U6 - https://doi.org/10.1145/3330430.3333644 PB - Association for Computing Machinery CY - New York ER -