TY  - JOUR
A1  - Wang, Cheng
A1  - Yang, Haojin
A1  - Meinel, Christoph
T1  - A deep semantic framework for multimodal representation learning
JF  - Multimedia tools and applications : an international journal
N2  - Multimodal representation learning has gained increasing importance in various real-world multimedia applications. Most previous approaches focused on exploring inter-modal correlation by learning a common or intermediate space in a conventional way, e.g. Canonical Correlation Analysis (CCA). These works neglected the exploration of fusing multiple modalities at higher semantic level. In this paper, inspired by the success of deep networks in multimedia computing, we propose a novel unified deep neural framework for multimodal representation learning. To capture the high-level semantic correlations across modalities, we adopted deep learning feature as image representation and topic feature as text representation respectively. In joint model learning, a 5-layer neural network is designed and enforced with a supervised pre-training in the first 3 layers for intra-modal regularization. The extensive experiments on benchmark Wikipedia and MIR Flickr 25K datasets show that our approach achieves state-of-the-art results compare to both shallow and deep models in multimodal and cross-modal retrieval.
KW  - Multimodal representation
KW  - Deep neural networks
KW  - Semantic feature
KW  - Cross-modal retrieval
Y1  - 2016
U6  - https://doi.org/10.1007/s11042-016-3380-8
SN  - 1380-7501
SN  - 1573-7721
VL  - 75
SP  - 9255
EP  - 9276
PB  - Springer
CY  - Dordrecht
ER  - 
TY  - JOUR
A1  - Phiri, Lighton
A1  - Meinel, Christoph
A1  - Suleman, Hussein
T1  - Streamlined orchestration: An orchestration workbench framework for
effective teaching
JF  - Current opinion in plant biology
N2  - Effective classroom management is considered a key criterion to making classrooms effective learning environments. Supporting classroom orchestration—the teacher-centric real-time management of classroom activities—is central to achieving effective classroom management. However, the multi-faceted nature of classroom orchestration, its complexity, and general classroom constraints such as time, present challenges for the effective management of the modern-day classroom environment. Though effective, most existing approaches for overcoming orchestration challenges, such as Google Classroom, are arguably ad hoc. We argue that streamlined technology-driven orchestration can be attained through the use of an orchestration workbench, potentially making educators more effective within formal learning environments. Early supporting evidence, from a study involving the use of a prototype orchestration tool, demonstrates the feasibility of organised orchestration and its potential to improve students' learning experience.
KW  - Computer-assisted instruction
KW  - Orchestration
KW  - Technology enhanced learning
Y1  - 2016
U6  - https://doi.org/10.1016/j.compedu.2016.01.011
SN  - 0360-1315
SN  - 1873-782X
VL  - 95
SP  - 231
EP  - 238
PB  - Elsevier
CY  - Oxford
ER  -