The TDLC Tool Kit is a list of databases, demos, software, and tutorials provided by TLDC members that may be useful for the Center. We are continually adding to this page, so please let us know
if you have other software or information you would like to add.
(Some of) The CAlifornia Facial Expressions dataset (CAFE) - http://cseweb.ucsd.edu/users/gary/CAFE/
These faces are supplied free of charge, for educational, research and non-profit purposes only.
Face-Place face database (Michael Tarr) - http://www.face-place.org/ (face-place tab)
This face database was created by the Tarrlab at Brown University. There are multiple images for over 200 individuals. The image database consists of many different races with consistent lighting, multiple views, real emotions, and disguises.
Machine Perception Laboratory Databases - http://mplab.ucsd.edu/?page_id=36
IR Marks video data set
A face motion data set of three video sequences.
The MPLab GENKI Database
An expanding database of images containing faces spanning a wide range of illumination conditions,
geographical locations, personal identity, and ethnicity.
RUFACS1 ( Rutgers/UCSD FacialActionCodingSystem Database 1)
Consists of spontaneous facial expressions from multiple views, with ground truth FACS codes
provided by two facial expression experts.
ORATOR (Expressive Speech Database)
Contains the wave soundfiles, evaluations, and descriptions of the Orator speech database.
TULIPS1 (Audiovisual Database)
A small Audiovisual database of 12 subjects saying the first 4 digits in English.
BEV1 Dataset: a resource for those who wish to begin exploring the visual world available to infants
Tarr Lab - http://wiki.cnbc.cmu.edu/TarrLab
Consists of stimuli created in the Tarr lab.
Poizner Lab - http://inc.ucsd.edu/~poizner/media.html
Demos include simultaneous EEG and full body motion capture while subjects freely move about large scale virtual environments; EEG recordings during freezing of gait in Parkinson's disease; simultaneous recording of hand, arm and eye movements as subjects look or reach to 3D targets; and simultaneous EEG and motion capture during reaching and grasping objects.
Machine Perception Laboratory Demos - http://mplab.ucsd.edu/?page_id=48
Automatic FACS Coding Demos, Demo of our 3D pose estimation system, Color Tracking, Demo of our Expression Recognizer, Real Time Expression Recognition, Blink Detection, Who is Talking?, The Cheese Project (Pasadena Art Center), Gflow Demos, Automatic FACS Coding Demos
Demo of real-room blind separation/deconvolution of two sources - http://www.cnl.salk.edu/~tewon/Blind/blind_audio.html
They present methods to separate blindly mixed signals recorded in a room. The learning algorithm is based on the information maximization in a single layer neural network.
A matlab neural net demo with face processing - eigenface_demo.zip
The Tarr Lab
ExpToolbox and Image Similarity Toolbox
|SOFTWARE AND CODE
Divvy: A tool for exploratory data analysis with unsupervised machine learning. "Use Divvy to better understand your scientific data."
Complex Systems Patterns Project - http://www.itee.uq.edu.au/~patterns/
Janet Wiles, James Watson, David Carrington and Jim Hanan
A long term project with the overall goal of capturing the wisdom of the complex systems modelling community. Its activities involve documenting patterns, and organising workshops for proposing and refining patterns, and provide a repository for collating patterns useful to complex systems modellers.
The original Independent Components Analyses - ftp://ftp.cnl.salk.edu/pub/tony/sep96.public
Basic ICA code in MATLAB (as used in Bell and Sejnowski 1996 (as used in Bell and Sejnowski 1996)
EEGLAB - http://sccn.ucsd.edu/eeglab/
Scott Makeig et al.'s interactive Matlab toolbox for processing continuous and event-related EEG, MEG and other electrophysiological data incorporating independent component analysis (ICA), time/frequency analysis, artifact rejection, event-related statistics, and several useful modes of visualization of the averaged and single-trial data. First developed on Matlab 5.3 under Linux, EEGLAB runs on Matlab v5 and higher under Linux, Unix, Windows, and Mac OS X (Matlab 7 recommended). Links in this page include a tutorial on using ICA for EEG decomposition.
Code for Gary Cottrell lab's real-time video salience algorithm - http://mplab.ucsd.edu/~nick/NMPT/
For more info, please see Nick's Machine Perception Toolbox (below).
Machine Perception Laboratory: Software - http://mplab.ucsd.edu/?page_id=66
Nick’s Machine Perception Toolbox (NMPT) - http://mplab.ucsd.edu/~nick/NMPT/
A C++ and OpenCV based open source Machine Perception API. It is being developed as part of an NSF funded project to use information maximization as a conceptual framework for unifying perception and action. The central philosophy of this package is three-fold: (1) Easy to Install; (2) Easy to Learn API; (3) Easy to Run. In this first release of Version 0.1, the main component of NMPT is an ultra-efficient implementation of the SUN model, a maximum-information approach to visual saliency developed by Zhang & Cottrell. Future versions of NMPT will also include facilities for optimal visual search. NMPT has been tested in MacOSX 10.4+ and Windows XP with Cygwin, and was developed to be fully cross-platform.
RUBIOS 2.0 -
A Java based Open Source communications API for for Social Robots. It was developed as part of the RUBI project to be the backbone for interconnecting the different perceptual and control modules of the RUBI robot. RUBI is a social robot developed to interact with toddlers and assist teachers in early childhood education settings. RUBIOS is has been battle tested in MacOSX 10.4.X and Windows XP with Cygwin.
MPT Machine Perception Toolbox -
MPT supplies cross-platform C++ libraries for real-time perception primitives, including face detection, eye detection, blink detection, color tracking. Soon it will also include expression recognition, predictive color tracking, and tracking based on multisensor fusion. In addition, MPT supplies many examples which show how to embed the MPT funct ions in applications, and which are useful applications in their own right. Finally, Matlab .mex interfaces are provided for many of these core libraries for those who like using Matlab.
SCORE digital video coding tool - http://mpscore.sourceforge.net/facs.php
A toolbox MPT developed to facilitate manual coding of video sequences. It is a modular tool that can be easily modified for other video annotating applications.
Let's Face It! - Face recognition training program (for personal purposes only; not to sell, distribute, or use for research)
Note: You will need to create an account on their site to access their "Downloads" page.
Let's Face It! is a joint project between the University of Victoria Brain and Cognition Lab and the Yale Child Study Centre. The program is a multimedia, computer-based intervention that is designed to teach face processing skills to children with autism.
The Buzsaki Lab - Viewers for electrophysiological and behavioral data
(http://osiris.rutgers.edu/frontmid/indexmid.html > Click on Downloads in left menu)
An advanced viewer for electrophysiological and behavioral data: it can display local field potentials (EEG), neuronal spikes, behavioral events, as well as the position of the animal in the environment. It also features limited editing capabilities.
A powerful and easy-to-use cluster cutting application designed to help neurophysiologists sort action potentials from multiple neurons on groups of electrodes (e.g., tetrodes or multisite silicon probes).
Software for Automatic Clustering - KlustaKwik
A program for automatic cluster analysis, specifically designed to run fast on large data sets.
Toolbox contents include the following (click here)
Tarrlab Software (http://wiki.cnbc.cmu.edu/Resources)
Software for creating stimuli, running experiments, and analyzing data on the macintosh
The best software solution for running psychophysical experiments (requires Matlab)
Stimulus Manipulation - Free and almost free software for manipulating images or sounds
Neuroimaging - Useful pages and code to help learn about and run neuroimaging studies
Statistics - Statistics packages and learning tools
The de Sa Lab (http://www.cogsci.ucsd.edu/~desa/resources.html - Resources Page)
Machine Perception Laboratory: Tutorials (http://mplab.ucsd.edu/?page_id=75)
Sequential Least Squares,POMDPs and Infomax Control, Variational EM, Gabor Filters, Stochastic Differential Equations, Discrete Time Kalman Filtering, Stochastic Optimal Control, Multinomial Logistic Regression, Introduction to Probability Theory and Statistics (Undergraduate Textbook),Generalized Factor Analysis, Exponential Smoothing, Hidden Markov Models, Principal Component Analysis, Sequential Sampling Methods, Axiomatic Set Theory, The Singular Value Decomposition, Image Formation Models, Matrix Recipes, Calculus of Variations, Useful Mathematical Facts, Physics for Robotics and Animation: A Gaussian Approach, Pneumatic Cylinders, DC Motors, The Discrete Fourier Transfor
General Resources and Helpful Links
|GENERAL RESOURCES AND HELPFUL LINKS
The Tarr Lab - useful software tools (bottom of page)
TextWrangler is a General Purpose Text Editor | Programmer's Text Editor | Powerful Text Transformer And Manipulator | Courtesy of BareBones Software
Name Mangler is a free batch file renamer. It currently supports the following basic renaming routines: Find and replace (including support for
regular expressions); Number sequentially; Change case; Set extension; Add prefix/suffix; Remove/insert characters. The new 2.0 version does much more.
LineBreak is a simple utility for Mac OS X that converts line breaks in text documents. It can convert to Mac, UNIX®, and Windows/DOS formats
Tools Free and useful software tools TextWrangler TextWrangler is a General Purpose Text Editor | Programmer's Text Editor | Powerful Text Transformer And Manipulator | Courtesy of BareBones Software Name Mangler Name Mangler is a free batch file renamer. It currently supports the following basic renaming routines: Find and replace (including support for regular expressions); Number sequentially; Change case; Set extension; Add prefix/suffix; Remove/insert characters. The new 2.0 version does much more. LineBreak LineBreak is a simple utility for Mac OS X that converts line breaks in text documents. It can convert to Mac, UNIX®, and Windows/DOS formats.