TY - JOUR A1 - Haider, Peter A1 - Scheffer, Tobias T1 - Bayesian clustering for email campaign detection Y1 - 2009 SN - 978-1-605-58516-1 ER - TY - JOUR A1 - Sawade, Christoph A1 - Bickel, Steffen A1 - von Oertzen, Timo A1 - Scheffer, Tobias A1 - Landwehr, Niels T1 - Active evaluation of ranking functions based on graded relevance JF - Machine learning N2 - Evaluating the quality of ranking functions is a core task in web search and other information retrieval domains. Because query distributions and item relevance change over time, ranking models often cannot be evaluated accurately on held-out training data. Instead, considerable effort is spent on manually labeling the relevance of query results for test queries in order to track ranking performance. We address the problem of estimating ranking performance as accurately as possible on a fixed labeling budget. Estimates are based on a set of most informative test queries selected by an active sampling distribution. Query labeling costs depend on the number of result items as well as item-specific attributes such as document length. We derive cost-optimal sampling distributions for the commonly used performance measures Discounted Cumulative Gain and Expected Reciprocal Rank. Experiments on web search engine data illustrate significant reductions in labeling costs. KW - Information retrieval KW - Ranking KW - Active evaluation Y1 - 2013 U6 - https://doi.org/10.1007/s10994-013-5372-5 SN - 0885-6125 VL - 92 IS - 1 SP - 41 EP - 64 PB - Springer CY - Dordrecht ER - TY - JOUR A1 - Landwehr, Niels A1 - Kuehn, Nicolas M. A1 - Scheffer, Tobias A1 - Abrahamson, Norman A. T1 - A Nonergodic Ground-Motion Model for California with Spatially Varying Coefficients JF - Bulletin of the Seismological Society of America N2 - Traditional probabilistic seismic-hazard analysis as well as the estimation of ground-motion models (GMMs) is based on the ergodic assumption, which means that the distribution of ground motions over time at a given site is the same as their spatial distribution over all sites for the same magnitude, distance, and site condition. With a large increase in the number of recorded ground-motion data, there are now repeated observations at given sites and from multiple earthquakes in small regions, so that assumption can be relaxed. We use a novel approach to develop a nonergodic GMM, which is cast as a varying-coefficient model (VCM). In this model, the coefficients are allowed to vary by geographical location, which makes it possible to incorporate effects of spatially varying source, path, and site conditions. Hence, a separate set of coefficients is estimated for each source and site coordinate in the data set. The coefficients are constrained to be similar for spatially nearby locations. This is achieved by placing a Gaussian process prior on the coefficients. The amount of correlation is determined by the data. The spatial correlation structure of the model allows one to extrapolate the varying coefficients to a new location and trace the corresponding uncertainties. The approach is illustrated with the Next Generation Attenuation-West2 data set, using only Californian records. The VCM outperforms a traditionally estimated GMM in terms of generalization error and leads to a reduction in the aleatory standard deviation by similar to 40%, which has important implications for seismic-hazard calculations. The scaling of the model with respect to its predictor variables such as magnitude and distance is physically plausible. The epistemic uncertainty associated with the predicted ground motions is small in places where events or stations are close and large where data are sparse. Y1 - 2016 U6 - https://doi.org/10.1785/0120160118 SN - 0037-1106 SN - 1943-3573 VL - 106 SP - 2574 EP - 2583 PB - Seismological Society of America CY - Albany ER -