TY - JOUR A1 - Wilson, Charlie A1 - Guivarch, Céline A1 - Kriegler, Elmar A1 - van Ruijven, Bas A1 - van Vuuren, Detlef P. A1 - Krey, Volker A1 - Schwanitz, Valeria Jana A1 - Thompson, Erica L. T1 - Evaluating process-based integrated assessment models of climate change mitigation JF - Climatic change N2 - Process-based integrated assessment models (IAMs) project long-term transformation pathways in energy and land-use systems under what-if assumptions. IAM evaluation is necessary to improve the models’ usefulness as scientific tools applicable in the complex and contested domain of climate change mitigation. We contribute the first comprehensive synthesis of process-based IAM evaluation research, drawing on a wide range of examples across six different evaluation methods including historical simulations, stylised facts, and model diagnostics. For each evaluation method, we identify progress and milestones to date, and draw out lessons learnt as well as challenges remaining. We find that each evaluation method has distinctive strengths, as well as constraints on its application. We use these insights to propose a systematic evaluation framework combining multiple methods to establish the appropriateness, interpretability, credibility, and relevance of process-based IAMs as useful scientific tools for informing climate policy. We also set out a programme of evaluation research to be mainstreamed both within and outside the IAM community. KW - process-based integrated assessment model KW - IAM KW - evaluation KW - climate mitigation Y1 - 2021 U6 - https://doi.org/10.1007/s10584-021-03099-9 SN - 0165-0009 SN - 1573-1480 VL - 166 IS - 1-2 PB - Springer Science + Business Media B.V. CY - Dordrecht ER - TY - THES A1 - Wilhelm, Jan Lorenz T1 - Wozu Evaluation? Organisationssysteme bewerten Stadtteilförderung mit Kalkül T1 - Evaluation and urban development : handling complexity and expectations N2 - In den letzten 20 Jahren sind Evaluationen Schritt für Schritt zu einem festen und gleichzeitig kontrovers diskutierten Bestandteil politischer Förderung geworden. Auf der Basis langjähriger Beobachtungen der Evaluationspraxis des Förderprogramms „Soziale Stadt“ zeigt dieses Buch zunächst, dass Evaluationstätigkeiten in Ministerien, Kommunalverwaltungen und Planungsbüros mit ganz unterschiedlichen Erwartungen, Herausforderungen, Widersprüchen und Irritationen verknüpft werden. Evaluationen werden dabei sowohl als Hoffnungsträger, als auch als Schreckgespenst gesehen. Der Autor nimmt diese Beobachtungen zum Anlass, den Umgang mit Evaluationen in politischen Organisationen kritisch zu hinterfragen und systematisch zu erklären. Reduziert auf die Frage „Wozu Evaluation?“ wird auf der Basis eines systemtheoretischen Zugangs erklärt, welche unterschiedlichen Funktionen Evaluationen in Organisationen erfüllen können. Vertiefend wird dabei auf organisationales Lernen, auf politische Steuerungslogik und auf die Notwendigkeit von Symbolisierungen eingegangen. N2 - The neighborhood development program “Social City” aims to discontinue the downward tendency of so-called disadvantaged neighborhoods by funding numerous projects. In the course of the program implementation, the method of evaluation – as a target-performance analysis – becomes more and more relevant. But whether something can be called a successful neighborhood management or a successful measure of integration strongly depends on its context and the point of view. For this reason evaluation research says that the effects of programs are usually only indicated unsatisfactorily. These observations lead to the research aim, to explain the function of evaluations for the constitution of development programs beyond usual arguments of effectiveness and efficiency. Using a system theoretical approach Wilhelm analyzed the explicit and implicit norms and observation schemes of a successful program implementation. The following theses on the role of evaluations in program implementations can be derived: a) Evaluations lay down the change in the distinctions of political intervention and facilitate communication about success,b) Evaluations manifest the differentiation between underprivileged and privileged neighborhoods in the program and help to legitimate it, c) evaluations actualize the funding programs’ ability to absorb insecurity and finally d) evaluations take the “illusion of control” inherent to every political strategy of intervention as a basis and thus contribute to its manifestation. T3 - Potsdamer Geographische Praxis - 2 KW - Evaluation KW - Städtebauförderung KW - Systemtheorie KW - Neue Kulturgeographie KW - Organisationslernen KW - Evaluationsfunktion KW - evaluation KW - system theory KW - urban development KW - human geography KW - learning organization KW - function of evaluation Y1 - 2012 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus-59833 SN - 978-3-86956-187-5 PB - Universitätsverlag Potsdam CY - Potsdam ER - TY - JOUR A1 - Waitelonis, Jörg A1 - Jürges, Henrik A1 - Sack, Harald T1 - Remixing entity linking evaluation datasets for focused benchmarking JF - Semantic Web N2 - In recent years, named entity linking (NEL) tools were primarily developed in terms of a general approach, whereas today numerous tools are focusing on specific domains such as e.g. the mapping of persons and organizations only, or the annotation of locations or events in microposts. However, the available benchmark datasets necessary for the evaluation of NEL tools do not reflect this focalizing trend. We have analyzed the evaluation process applied in the NEL benchmarking framework GERBIL [in: Proceedings of the 24th International Conference on World Wide Web (WWW’15), International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, Switzerland, 2015, pp. 1133–1143, Semantic Web 9(5) (2018), 605–625] and all its benchmark datasets. Based on these insights we have extended the GERBIL framework to enable a more fine grained evaluation and in depth analysis of the available benchmark datasets with respect to different emphases. This paper presents the implementation of an adaptive filter for arbitrary entities and customized benchmark creation as well as the automated determination of typical NEL benchmark dataset properties, such as the extent of content-related ambiguity and diversity. These properties are integrated on different levels, which also enables to tailor customized new datasets out of the existing ones by remixing documents based on desired emphases. Besides a new system library to enrich provided NIF [in: International Semantic Web Conference (ISWC’13), Lecture Notes in Computer Science, Vol. 8219, Springer, Berlin, Heidelberg, 2013, pp. 98–113] datasets with statistical information, best practices for dataset remixing are presented, and an in depth analysis of the performance of entity linking systems on special focus datasets is presented. KW - Entity Linking KW - GERBIL KW - evaluation KW - benchmark Y1 - 2019 U6 - https://doi.org/10.3233/SW-180334 SN - 1570-0844 SN - 2210-4968 VL - 10 IS - 2 SP - 385 EP - 412 PB - IOS Press CY - Amsterdam ER - TY - THES A1 - von Kaphengst, Dragana T1 - Project’s management quality in development cooperation T1 - Managementqualität von Projekten in der Entwicklungszusammenarbeit N2 - In light of the debate on the consequences of competitive contracting out of traditionally public services, this research compares two mechanisms used to allocate funds in development cooperation—direct awarding and competitive contracting out—aiming to identify their potential advantages and disadvantages. The agency theory is applied within the framework of rational-choice institutionalism to study the institutional arrangements that surround two different money allocation mechanisms, identify the incentives they create for the behavior of individual actors in the field, and examine how these then transfer into measurable differences in managerial quality of development aid projects. In this work, project management quality is seen as an important determinant of the overall project success. For data-gathering purposes, the German development agency, the Gesellschaft für Internationale Zusammenarbeit (GIZ), is used due to its unique way of work. Whereas the majority of projects receive funds via direct-award mechanism, there is a commercial department, GIZ International Services (GIZ IS) that has to compete for project funds. The data concerning project management practices on the GIZ and GIZ IS projects was gathered via a web-based, self-administered survey of project team leaders. Principal component analysis was applied to reduce the dimensionality of the independent variable to total of five components of project management. Furthermore, multiple regression analysis identified the differences between the separate components on these two project types. Enriched by qualitative data gathered via interviews, this thesis offers insights into everyday managerial practices in development cooperation and identifies the advantages and disadvantages of the two allocation mechanisms. The thesis first reiterates the responsibility of donors and implementers for overall aid effectiveness. It shows that the mechanism of competitive contracting out leads to better oversight and control of implementers, fosters deeper cooperation between the implementers and beneficiaries, and has a potential to strengthen ownership of recipient countries. On the other hand, it shows that the evaluation quality does not tremendously benefit from the competitive allocation mechanism and that the quality of the component knowledge management and learning is better when direct-award mechanisms are used. This raises questions about the lacking possibilities of actors in the field to learn about past mistakes and incorporate the finings into the future interventions, which is one of the fundamental issues of aid effectiveness. Finally, the findings show immense deficiencies in regard to oversight and control of individual projects in German development cooperation. KW - development cooperation KW - project management quality KW - evaluation KW - GIZ KW - knowledge management KW - Entwicklungszusammenarbeit KW - Qualität des Projektmanagements KW - Evaluierung KW - GIZ KW - Wissensmanagement Y1 - 2019 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-430992 ER - TY - THES A1 - Ullrich, André T1 - Eigenschaften wandlungsfähiger Systeme T1 - Characteristics of changeable systems BT - Erarbeitung eines Indikatorsystems BT - development of an indicator system N2 - Wandlungsfähigkeit beschreibt die Fähigkeit eines Systems, proaktiv oder reaktiv Maßnahmen für die Modifikation seiner Eigenschaften schnell und effizient zu entwickeln, umzusetzen und anzuwenden sowie sich proaktiv darauf vorzubereiten, inaktiv zu sein und passiv Einwirkungen aus der Umwelt zu tolerieren. Die Eigenschaften wandlungsfähiger Systeme werden häufig als Indikatoren (z.B. Modularität, Wissen) verwendet. Dabei existiert eine Vielzahl potenzieller Indikatoren, deren jeweilige Relevanz jedoch ungeklärt ist. Hier setzt die Zielstellung der vorliegenden Arbeit an. Das Erkenntnisziel ist die Erklärung der Wandlungsfähigkeit sozio-technischer Systeme. Zu diesem Zweck wird ein Erklärungsmodell der indikatorbasierten Wandlungsfähigkeit erstellt, das zum Nachweis von Wandlungsfähigkeit, zur Bewertung dieser sowie zur Systemanalyse genutzt werden kann. Weiterhin wird exemplarisch eine positive Korrelation von Wandlungsfähigkeit und Schnelligkeit sowie Effizienz bei Veränderungsprojekten nachgewiesen. N2 - Change capability describes the ability of a system to proactively or reactively develop, implement, and apply measures for the modification of its properties quickly and efficiently, as well as be proactively prepared to be inactive and passively tolerate environmental impacts. The properties of changeable systems are often used as indicators (e.g. modularity, knowledge) of change capability. Thus, diverse potential indicators exist. However, there is no reliable evidence of the relevance of any one in particular. This is exactly where the goal of this thesis sets in. The goal is the explanation of socio-technical systems’ change capability. For this purpose, an explanatory model of the indicator-based change capability is developed, that enables (1) empirical evidence of change capability, (2) evaluation of change capability, and (3) can be used for system analysis. Furthermore, an exemplary proof of a positive correlation between a system's high change capability and its high velocity and efficiency in implementing change projects is identified. KW - Bewertung KW - Systemanalyse KW - Wandlungsfähigkeit KW - change capability KW - evaluation KW - system analysis Y1 - 2018 SN - 978-3-95545-265-0 PB - GITO CY - Berlin ER - TY - JOUR A1 - Sallen, Jeffrey A1 - Hemming, Karen A1 - Richartz, Alfred T1 - Facilitating dual careers by improving resistance to chronic stress BT - effects of an intervention programme for elite student athletes JF - European journal of sport science : official journal of the European College of Sport Science N2 - The starting point of this contribution is the potential risk to health and performance from the combination of elite sporting careers with the pursuit of education. In European sport science and politics, structural measures to promote dual careers in elite sports have been discussed increasingly of late. In addition to organisational measures, there are calls for educational-psychological intervention programmes supporting the successful management of dual careers at the individual level. This paper presents an appropriate intervention programme and its evaluation: stress-resistance training for elite athletes (SRT-EA). It comprises 10 units, each lasting 90 minutes. It is intended for athletes and aims to improve their resistance to chronic stress. The evaluation was carried out in a quasi-experimental design, with three points of measurement (baseline, immediately after, and three months after) and two non-randomised groups: an intervention group (n=128) and an untreated control group (n=117). Participants were between 13 and 20 years of age (53.5% male) and represented various Olympic sports. Outcome variables were assessed with questionnaires. Significant short- and mid-term intervention effects were explored. The intervention increased stress-related knowledge, general self-efficacy, and stress sensitivity. Chronic stress level, stress symptoms, and stress reactivity were reduced. In line with the intention of the intervention, the results showed short- and mid-term, small to medium-sized effects. Accordingly, separate measurements at the end of the intervention and three months later showed mostly positive subjective experiences. Thus, the results reinforce the hope that educational-psychological stress-management interventions can support dual careers. KW - Chronic stress KW - stress-resistance KW - elite athletes KW - intervention KW - evaluation Y1 - 2017 U6 - https://doi.org/10.1080/17461391.2017.1407363 SN - 1746-1391 SN - 1536-7290 VL - 18 IS - 1 SP - 112 EP - 122 PB - Routledge, Taylor & Francis Group CY - Abingdon ER - TY - GEN A1 - Sallen, Jeffrey A1 - Hemming, Karen A1 - Richartz, Alfred T1 - Facilitating dual careers by improving resistance to chronic stress BT - effects of an intervention programme for elite student athletes T2 - Postprints der Universität Potsdam : Humanwissenschaftliche Reihe N2 - The starting point of this contribution is the potential risk to health and performance from the combination of elite sporting careers with the pursuit of education. In European sport science and politics, structural measures to promote dual careers in elite sports have been discussed increasingly of late. In addition to organisational measures, there are calls for educational-psychological intervention programmes supporting the successful management of dual careers at the individual level. This paper presents an appropriate intervention programme and its evaluation: stress-resistance training for elite athletes (SRT-EA). It comprises 10 units, each lasting 90 minutes. It is intended for athletes and aims to improve their resistance to chronic stress. The evaluation was carried out in a quasi-experimental design, with three points of measurement (baseline, immediately after, and three months after) and two non-randomised groups: an intervention group (n = 128) and an untreated control group (n = 117). Participants were between 13 and 20 years of age (53.5% male) and represented various Olympic sports. Outcome variables were assessed with questionnaires. Significant short- and mid-term intervention effects were explored. The intervention increased stress-related knowledge, general self-efficacy, and stress sensitivity. Chronic stress level, stress symptoms, and stress reactivity were reduced. In line with the intention of the intervention, the results showed short- and mid-term, small to medium-sized effects. Accordingly, separate measurements at the end of the intervention and three months later showed mostly positive subjective experiences. Thus, the results reinforce the hope that educational-psychological stress-management interventions can support dual careers. T3 - Zweitveröffentlichungen der Universität Potsdam : Humanwissenschaftliche Reihe - 463 KW - chronic stress KW - stress-resistance KW - elite athletes KW - intervention KW - evaluation Y1 - 2018 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-412735 IS - 463 ER - TY - JOUR A1 - Rosin, Paul L. A1 - Lai, Yu-Kun A1 - Mould, David A1 - Yi, Ran A1 - Berger, Itamar A1 - Doyle, Lars A1 - Lee, Seungyong A1 - Li, Chuan A1 - Liu, Yong-Jin A1 - Semmo, Amir A1 - Shamir, Ariel A1 - Son, Minjung A1 - Winnemöller, Holger T1 - NPRportrait 1.0: A three-level benchmark for non-photorealistic rendering of portraits JF - Computational visual media N2 - Recently, there has been an upsurge of activity in image-based non-photorealistic rendering (NPR), and in particular portrait image stylisation, due to the advent of neural style transfer (NST). However, the state of performance evaluation in this field is poor, especially compared to the norms in the computer vision and machine learning communities. Unfortunately, the task of evaluating image stylisation is thus far not well defined, since it involves subjective, perceptual, and aesthetic aspects. To make progress towards a solution, this paper proposes a new structured, three-level, benchmark dataset for the evaluation of stylised portrait images. Rigorous criteria were used for its construction, and its consistency was validated by user studies. Moreover, a new methodology has been developed for evaluating portrait stylisation algorithms, which makes use of the different benchmark levels as well as annotations provided by user studies regarding the characteristics of the faces. We perform evaluation for a wide variety of image stylisation methods (both portrait-specific and general purpose, and also both traditional NPR approaches and NST) using the new benchmark dataset. KW - non-photorealistic rendering (NPR) KW - image stylization KW - style transfer KW - portrait KW - evaluation KW - benchmark Y1 - 2022 U6 - https://doi.org/10.1007/s41095-021-0255-3 SN - 2096-0433 SN - 2096-0662 VL - 8 IS - 3 SP - 445 EP - 465 PB - Springer Nature CY - London ER - TY - BOOK A1 - Rolfes, Manfred A1 - Schubarth, Wilfried A1 - Kohlstruck, Michael A1 - Bode, Dagmar ED - Rolfes, Manfred T1 - Das Handlungskonzept „Tolerantes Brandenburg“ im Fokus BT - Auseinandersetzungen mit Rechtsextremismus und Rechtspopulismus im Bundesland Brandenburg T3 - Potsdamer Geographische Praxis N2 - Dieser Band der Reihe „Potsdamer Geographische Praxis“ enthält drei Beiträge, die sich mit dem Handlungskonzept „Tolerantes Brandenburg“ der Brandenburgischen Landesregierung befassen. In allen Beiträgen wird auf der Grundlage empirischer Erhebungen analysiert, wie dieses Konzept zum Umgang mit Rechtsextremismus und Rechtspopulismus sowie zur Demokratieförderung in den letzten Jahren umgesetzt wurde. Die ersten beiden Beiträge haben die sogenannten Zukunftsdialoge „Tolerantes Brandenburg“ zum Gegenstand, die in den Jahren 2015 bis 2017 in allen kreisfreien Städten und Landkreisen Brandenburgs durchgeführt wurden. Der erste Beitrag von Schubarth, Kohlstruck und Rolfes beinhaltet die Ergebnisse der wissenschaftlichen Beobachtung der Zukunftsdialoge; die Ergebnisse beruhen überwiegend auf teilnehmenden Beobachtungen der Zukunftsdialoge und qualitativen Interviews mit Teilnehmenden. Der zweite Beitrag von Bode und Rolfes basiert auf einer quantitativen Methodik und enthält die Auswertungen einer standardisierten Befragung der Teilnehmer/innen der Zukunftsdialoge. Die Ergebnisse beider Untersuchungen liefern wichtige Erkenntnisse und gute Ansatzpunkte, wie einerseits die Institutionen des Beratungsnetzwerks „Tolerantes Brandenburg“ und das Handlungskonzept auf lokaler Ebene eine größere Bekanntheit erlangen könnten und andererseits, welche Schritte hilfreich wären, um eine (noch) stärkere Verankerung des Handlungskonzeptes in den Regionen zu erreichen. Beim dritten Beitrag von Schubarth, Kohlstruck und Rolfes handelt es sich eine Expertise aus dem Jahr 2019. Der Beitrag liefert einen mehrdimensionalen Blick auf das Handlungskonzept aus unterschiedlichen internen wie externen Perspektiven. Dabei wird vor allem auf die gesellschaftlichen und politischen Veränderungen fokussiert, die sich seit 2014 im Handlungsfeld „Demokratiestärkung und Auseinandersetzung mit dem Rechtsextremismus“ ergeben haben. Grundlage der Expertise waren leitfadenzentrierte Interviews. T3 - Potsdamer Geographische Praxis - 15 KW - Rechtsextremismus KW - Rechtspopulismus KW - Demokratieförderung KW - Brandenburg KW - Tolerantes Brandenburg KW - Evaluation KW - right-wing extremism KW - right-wing populism KW - democracy-building KW - Brandenburg KW - evaluation Y1 - 2020 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:kobv:517-opus4-441418 SN - 978-3-86956-483-8 SN - 2194-1599 SN - 2194-1602 IS - 15 PB - Universitätsverlag Potsdam CY - Potsdam ER - TY - CHAP A1 - Rojahn, Marcel A1 - Gronau, Norbert ED - Bui, Tung X. T1 - Openness indicators for the evaluation of digital platforms between the launch and maturity phase T2 - Proceedings of the 57th Annual Hawaii International Conference on System Sciences N2 - In recent years, the evaluation of digital platforms has become an important focus in the field of information systems science. The identification of influential indicators that drive changes in digital platforms, specifically those related to openness, is still an unresolved issue. This paper addresses the challenge of identifying measurable indicators and characterizing the transition from launch to maturity in digital platforms. It proposes a systematic analytical approach to identify relevant openness indicators for evaluation purposes. The main contributions of this study are the following (1) the development of a comprehensive procedure for analyzing indicators, (2) the categorization of indicators as evaluation metrics within a multidimensional grid-box model, (3) the selection and evaluation of relevant indicators, (4) the identification and assessment of digital platform architectures during the launch-to-maturity transition, and (5) the evaluation of the applicability of the conceptualization and design process for digital platform evaluation. KW - federated industrial platform ecosystems KW - technologies KW - business models KW - data-driven artifacts KW - design-science research KW - digital platform openness KW - evaluation KW - morphological analysis Y1 - 2024 SN - 978-0-99813-317-1 SP - 4516 EP - 4525 PB - Department of IT Management Shidler College of Business University of Hawaii CY - Honolulu, HI ER -