PETS 2006 Benchmark Data
http://www.cvg.rdg.ac.uk/PETS2006/data.html

Benchmarks for Advanced Video and Signal based Surveillance
http://www.eecs.qmul.ac.uk/~andrea/avss2007_d.html
ftp://motinas.elec.qmul.ac.uk/pub/iLids/

LIVE Video Quality Database from Prof. Alan C. Bovi's Laboratory for Image & Video Engineering at The University of Texas at Austin. .
http://live.ece.utexas.edu/research/quality/live_video.html

NICTA Pedestrian Dataset
http://nicta.com.au/research/projects/AutoMap/computer_vision_datasets
Thanks for Chih Hsiang Chang Chang in the ECE department of UT Dallas provides these links.