Advances in Domain Adaptation Theory

Advances in Domain Adaptation Theory gives current, state-of-the-art results on transfer learning, with a particular focus placed on domain adaptation from a theoretical point-of-view. The book begins with a brief overview of the most popular concepts used to provide generalization guarantees, including sections on Vapnik-Chervonenkis (VC), Rademacher, PAC-Bayesian, Robustness and Stability based bounds. In addition, the book explains domain adaptation problem and describes the four major families of theoretical results that exist in the literature, including the Divergence based bounds. Next, PAC-Bayesian bounds are discussed, including the original PAC-Bayesian bounds for domain adaptation and their updated version. Additional sections present generalization guarantees based on the robustness and stability properties of the learning algorithm. Gives an overview of current results on transfer learning Focuses on the adaptation of the field from a theoretical point-of-view Describes four major families of theoretical results in the literature Summarizes existing results on adaptation in the field Provides tips for future research

The annual conference on NIPS is the flagship conference on neural computation. It draws top academic researchers from around the world & is considered to be a showcase conference for new developments in network algorithms & architectures. This volume contains all of the papers presented at NIPS 2006.

Pedestrian Protection Systems (PPSs) are on-board systems aimed at detecting and tracking people in the surroundings of a vehicle in order to avoid potentially dangerous situations. These systems, together with other Advanced Driver Assistance Systems (ADAS) such as lane departure warning or adaptive cruise control, are one of the most promising ways to improve traffic safety. By the use of computer vision, cameras working either in the visible or infra-red spectra have been demonstrated as a reliable sensor to perform this task. Nevertheless, the variability of human’s appearance, not only in terms of clothing and sizes but also as a result of their dynamic shape, makes pedestrians one of the most complex classes even for computer vision. Moreover, the unstructured changing and unpredictable environment in which such on-board systems must work makes detection a difficult task to be carried out with the demanded robustness. In this brief, the state of the art in PPSs is introduced through the review of the most relevant papers of the last decade. A common computational architecture is presented as a framework to organize each method according to its main contribution. More than 300 papers are referenced, most of them addressing pedestrian detection and others corresponding to the descriptors (features), pedestrian models, and learning machines used. In addition, an overview of topics such as real-time aspects, systems benchmarking and future challenges of this research area are presented.

This open access book constitutes the proceedings of the 18th International Conference on Intelligent Data Analysis, IDA 2020, held in Konstanz, Germany, in April 2020. The 45 full papers presented in this volume were carefully reviewed and selected from 114 submissions. Advancing Intelligent Data Analysis requires novel, potentially game-changing ideas. IDA’s mission is to promote ideas over performance: a solid motivation can be as convincing as exhaustive empirical evaluation.

An overview of recent efforts in the machine learning community to deal with dataset and covariate shift, which occurs when test and training inputs and outputs have different distributions. Dataset shift is a common problem in predictive modeling that occurs when the joint distribution of inputs and outputs differs between training and test stages. Covariate shift, a particular case of dataset shift, occurs when only the input distribution changes. Dataset shift is present in most practical applications, for reasons ranging from the bias introduced by experimental design to the irreproducibility of the testing conditions at training time. (An example is -email spam filtering, which may fail to recognize spam that differs in form from the spam the automatic filter has been built on.) Despite this, and despite the attention given to the apparently similar problems of semi-supervised learning and active learning, dataset shift has received relatively little attention in the machine learning community until recently. This volume offers an overview of current efforts to deal with dataset and covariate shift. The chapters offer a mathematical and philosophical introduction to the problem, place dataset shift in relationship to transfer learning, transduction, local learning, active learning, and semi-supervised learning, provide theoretical views of dataset and covariate shift (including decision theoretic and Bayesian perspectives), and present algorithms for covariate shift. Contributors Shai Ben-David, Steffen Bickel, Karsten Borgwardt, Michael Brückner, David Corfield, Amir Globerson, Arthur Gretton, Lars Kai Hansen, Matthias Hein, Jiayuan Huang, Choon Hui Teo, Takafumi Kanamori, Klaus-Robert Müller, Sam Roweis, Neil Rubens, Tobias Scheffer, Marcel Schmittfull, Bernhard Schölkopf Hidetoshi Shimodaira, Alex Smola, Amos Storkey, Masashi Sugiyama

The First Asian Conference on Machine Learning (ACML 2009) was held at Nanjing, China during November 2–4, 2009.This was the ?rst edition of a series of annual conferences which aim to provide a leading international forum for researchers in machine learning and related ?elds to share their new ideas and research ?ndings. This year we received 113 submissions from 18 countries and regions in Asia, Australasia, Europe and North America. The submissions went through a r- orous double-blind reviewing process. Most submissions received four reviews, a few submissions received ?ve reviews, while only several submissions received three reviews. Each submission was handled by an Area Chair who coordinated discussions among reviewers and made recommendation on the submission. The Program Committee Chairs examined the reviews and meta-reviews to further guarantee the reliability and integrity of the reviewing process. Twenty-nine - pers were selected after this process. To ensure that important revisions required by reviewers were incorporated into the ?nal accepted papers, and to allow submissions which would have - tential after a careful revision, this year we launched a “revision double-check” process. In short, the above-mentioned 29 papers were conditionally accepted, and the authors were requested to incorporate the “important-and-must”re- sionssummarizedbyareachairsbasedonreviewers’comments.Therevised?nal version and the revision list of each conditionally accepted paper was examined by the Area Chair and Program Committee Chairs. Papers that failed to pass the examination were ?nally rejected.

This book presents the original articles that have been accepted in the 2019 INNS Big Data and Deep Learning (INNS BDDL) international conference, a major event for researchers in the field of artificial neural networks, big data and related topics, organized by the International Neural Network Society and hosted by the University of Genoa. In 2019 INNS BDDL has been held in Sestri Levante (Italy) from April 16 to April 18. More than 80 researchers from 20 countries participated in the INNS BDDL in April 2019. In addition to regular sessions, INNS BDDL welcomed around 40 oral communications, 6 tutorials have been presented together with 4 invited plenary speakers. This book covers a broad range of topics in big data and deep learning, from theoretical aspects to state-of-the-art applications. This book is directed to both Ph.D. students and Researchers in the field in order to provide a general picture of the state-of-the-art on the topics addressed by the conference.

This book constitutes the refereed proceedings of the 11th European Conference on Principles and Practice of Knowledge Discovery in Databases, PKDD 2007, held in Warsaw, Poland, co-located with ECML 2007, the 18th European Conference on Machine Learning. The 28 revised full papers and 35 revised short papers present original results on leading-edge subjects of knowledge discovery from conventional and complex data and address all current issues in the area.

This book gathers the carefully reviewed proceedings of the 19th International Conference on Systems Science, presenting recent research findings in the areas of Artificial Intelligence, Machine Learning, Communication/Networking and Information Technology, Control Theory, Decision Support, Image Processing and Computer Vision, Optimization Techniques, Pattern Recognition, Robotics, Service Science, Web-based Services, Uncertain Systems and Transportation Systems. The International Conference on Systems Science was held in Wroclaw, Poland from September 7 to 9, 2016, and addressed a range of topics, including systems theory, control theory, machine learning, artificial intelligence, signal processing, communication and information technologies, transportation systems, multi-robotic systems and uncertain systems, as well as their applications. The aim of the conference is to provide a platform for communication between young and established researchers and practitioners, fostering future joint research in systems science.

The three volume proceedings LNAI 10534 – 10536 constitutes the refereed proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases, ECML PKDD 2017, held in Skopje, Macedonia, in September 2017. The total of 101 regular papers presented in part I and part II was carefully reviewed and selected from 364 submissions; there are 47 papers in the applied data science, nectar and demo track. The contributions were organized in topical sections named as follows: Part I: anomaly detection; computer vision; ensembles and meta learning; feature selection and extraction; kernel methods; learning and optimization, matrix and tensor factorization; networks and graphs; neural networks and deep learning. Part II: pattern and sequence mining; privacy and security; probabilistic models and methods; recommendation; regression; reinforcement learning; subgroup discovery; time series and streams; transfer and multi-task learning; unsupervised and semisupervised learning. Part III: applied data science track; nectar track; and demo track.

Adaptive Learning Methods for Nonlinear System Modeling presents some of the recent advances on adaptive algorithms and machine learning methods designed for nonlinear system modeling and identification. Real-life problems always entail a certain degree of nonlinearity, which makes linear models a non-optimal choice. This book mainly focuses on those methodologies for nonlinear modeling that involve any adaptive learning approaches to process data coming from an unknown nonlinear system. By learning from available data, such methods aim at estimating the nonlinearity introduced by the unknown system. In particular, the methods presented in this book are based on online learning approaches, which process the data example-by-example and allow to model even complex nonlinearities, e.g., showing time-varying and dynamic behaviors. Possible fields of applications of such algorithms includes distributed sensor networks, wireless communications, channel identification, predictive maintenance, wind prediction, network security, vehicular networks, active noise control, information forensics and security, tracking control in mobile robots, power systems, and nonlinear modeling in big data, among many others. This book serves as a crucial resource for researchers, PhD and post-graduate students working in the areas of machine learning, signal processing, adaptive filtering, nonlinear control, system identification, cooperative systems, computational intelligence. This book may be also of interest to the industry market and practitioners working with a wide variety of nonlinear systems. Presents the key trends and future perspectives in the field of nonlinear signal processing and adaptive learning. Introduces novel solutions and improvements over the state-of-the-art methods in the very exciting area of online and adaptive nonlinear identification. Helps readers understand important methods that are effective in nonlinear system modelling, suggesting the right methodology to address particular issues.

The first book of its kind dedicated to the challenge of person re-identification, this text provides an in-depth, multidisciplinary discussion of recent developments and state-of-the-art methods. Features: introduces examples of robust feature representations, reviews salient feature weighting and selection mechanisms and examines the benefits of semantic attributes; describes how to segregate meaningful body parts from background clutter; examines the use of 3D depth images and contextual constraints derived from the visual appearance of a group; reviews approaches to feature transfer function and distance metric learning and discusses potential solutions to issues of data scalability and identity inference; investigates the limitations of existing benchmark datasets, presents strategies for camera topology inference and describes techniques for improving post-rank search efficiency; explores the design rationale and implementation considerations of building a practical re-identification system.

This comprehensive text/reference presents a broad review of diverse domain adaptation (DA) methods for machine learning, with a focus on solutions for visual applications. The book collects together solutions and perspectives proposed by an international selection of pre-eminent experts in the field, addressing not only classical image categorization, but also other computer vision tasks such as detection, segmentation and visual attributes. Topics and features: Surveys the complete field of visual DA, including shallow methods designed for homogeneous and heterogeneous data as well as deep architectures Presents a positioning of the dataset bias in the CNN-based feature arena Proposes detailed analyses of popular shallow methods that addresses landmark data selection, kernel embedding, feature alignment, joint feature transformation and classifier adaptation, or the case of limited access to the source data Discusses more recent deep DA methods, including discrepancy-based adaptation networks and adversarial discriminative DA models Addresses domain adaptation problems beyond image categorization, such as a Fisher encoding adaptation for vehicle re-identification, semantic segmentation and detection trained on synthetic images, and domain generalization for semantic part detection Describes a multi-source domain generalization technique for visual attributes and a unifying framework for multi-domain and multi-task learning This authoritative volume will be of great interest to a broad audience ranging from researchers and practitioners, to students involved in computer vision, pattern recognition and machine learning. Dr. Gabriela Csurka is a Senior Scientist in the Computer Vision Team at Xerox Research Centre Europe, Meylan, France.

This book constitutes the refereed proceedings of the 4th European Workshop on Case-Based Reasoning, EWCBR-98, held in Dublin, Ireland, in September 1998. The 41 revised full papers presented were carefully selected and reviewed for inclusion in the proceedings. The contributions address the representation and organization of cases in case-bases, the assessment of case similarity, the efficient retrieval of cases from large case-bases, the adaptation of similar case solutions to fit the current problem, case learning and case-base maintenance, and the application of CBR technology to real-world problems.

Despite being an accepted construct in traffic and transport psychology, the precise nature of behavioural adaptation, including its causes and consequences, has not yet been established within the road safety community. A comprehensive collection of recent literature, Behavioural Adaptation and Road Safety: Theory, Evidence, and Action explores behavioural adaptation in road users. It examines behavioural adaptation within the context of historical and theoretical perspectives, and puts forth tangible—and practical—solutions that can effectively address adverse behavioural adaptation to road safety interventions before it occurs. Edited by Christina Rudin-Brown and Samantha Jamson, with chapters authored by leading road safety experts in driver psychology and behaviour, the book introduces the concept of behavioural adaptation and details its more relevant issues. It reviews the definition of behavioural adaptation that was put forward by the OECD in 1990 and then puts this definition through its paces, identifying where it may be lacking and how it might be improved. This sets the context for the remaining chapters which take the OECD definition as their starting points. The book discusses the various theories and models of behavioural adaptation and more general theories of driver behaviour developed during the last half century. It provides examples of the "evidence" for behavioural adaptation—instances in which behavioural adaptation arose as a consequence of the introduction of safety countermeasures. The book then focuses on the internal, "human" element and considers countermeasures that might be used to limit the development of behavioural adaptation in various road user groups. The book concludes with practical tools and methodologies to address behavioural adaptation in research and design, and to limit the potential negative effects before they happen. Supplying easy-to-understand, accessible solutions that can be implemented early on in a road safety intervention’s design or conception phase, the chapters represent the most extensive compilation of literature relating to behavioural adaptation and its consequences since the 1990 OECD report. The book brings together earlier theories of behavioural adaptation with more recent theories in the area and combines them with practical advice, methods, and tangible solutions that can minimise the potential negative impact of behavioural adaptation on road user safety and address it before it occurs. It is an essential component of any road safety library, and should be of particular relevance to researchers, practitioners, designers, and policymakers who are interested in maximizing safety while at the same time encouraging innovation and excellence in road transport-related design.

Regularization, Optimization, Kernels, and Support Vector Machines offers a snapshot of the current state of the art of large-scale machine learning, providing a single multidisciplinary source for the latest research and advances in regularization, sparsity, compressed sensing, convex and large-scale optimization, kernel methods, and support vector machines. Consisting of 21 chapters authored by leading researchers in machine learning, this comprehensive reference: Covers the relationship between support vector machines (SVMs) and the Lasso Discusses multi-layer SVMs Explores nonparametric feature selection, basis pursuit methods, and robust compressive sensing Describes graph-based regularization methods for single- and multi-task learning Considers regularized methods for dictionary learning and portfolio selection Addresses non-negative matrix factorization Examines low-rank matrix and tensor-based models Presents advanced kernel methods for batch and online machine learning, system identification, domain adaptation, and image processing Tackles large-scale algorithms including conditional gradient methods, (non-convex) proximal techniques, and stochastic gradient descent Regularization, Optimization, Kernels, and Support Vector Machines is ideal for researchers in machine learning, pattern recognition, data mining, signal processing, statistical learning, and related areas.

The type of material considered for publication includes drafts of original papers or monographs, technical reports of high quality and broad interest, advanced-level lectures, reports of meetings, provided they are of exceptional interest and focused on a single topic.

A journey through a land where Milo learns the importance of words and numbers provides a cure for his boredom.

This book presents a collection of high-quality research by leading experts in computer vision and its applications. Each of the 16 chapters can be read independently and discusses the principles of a specific topic, reviews up-to-date techniques, presents outcomes, and highlights the challenges and future directions. As such the book explores the latest trends in fashion creative processes, facial features detection, visual odometry, transfer learning, face recognition, feature description, plankton and scene classification, video face alignment, video searching, and object segmentation. It is intended for postgraduate students, researchers, scholars and developers who are interested in computer vision and connected research disciplines, and is also suitable for senior undergraduate students who are taking advanced courses in related topics. However, it is also provides a valuable reference resource for practitioners from industry who want to keep abreast of recent developments in this dynamic, exciting and profitable research field.