Issue on starting training ....

[stoneyang]

Hi, @chuckcho :

Thanks for your code on 3D conv!

When following your instructions, I met the issue about data I/O, which tells me that the specified frames could not be loaded due to the total frames of that video clips is less than the required numbers.

I checked the video and the video itself is complete and not corrupted.

Any suggestions would be appreciated. Thanks in advance!

Attached is the snippet of running log and hope it will be helpful to demonstrate the issue.

I0130 16:44:19.764094 18643 net.cpp:255] Network initialization done.
I0130 16:44:19.764217 18643 solver.cpp:56] Solver scaffolding done.
I0130 16:44:19.764993 18643 caffe.cpp:248] Starting Optimization
I0130 16:44:21.659896 19209 video_data_layer.cpp:39] Opening file examples/c3d_ucf101/c3d_ucf101_train_split1_r.txt
I0130 16:44:21.725683 19206 video_data_layer.cpp:39] Opening file examples/c3d_ucf101/c3d_ucf101_train_split1_r.txt
I0130 16:44:21.728209 19207 video_data_layer.cpp:39] Opening file examples/c3d_ucf101/c3d_ucf101_train_split1_r.txt
I0130 16:44:21.769105 19209 video_data_layer.cpp:55] Shuffling data
I0130 16:44:21.819924 19209 video_data_layer.cpp:65] A total of 107258 video chunks.
I0130 16:44:21.829344 19207 video_data_layer.cpp:55] Shuffling data
I0130 16:44:21.839767 19206 video_data_layer.cpp:55] Shuffling data
I0130 16:44:21.870241 19209 video_data_layer.cpp:105] output data size: 50,3,16,112,112
I0130 16:44:21.926066 19207 video_data_layer.cpp:65] A total of 107258 video chunks.
I0130 16:44:21.937933 19206 video_data_layer.cpp:65] A total of 107258 video chunks.
I0130 16:44:22.022068 19207 video_data_layer.cpp:105] output data size: 50,3,16,112,112
I0130 16:44:22.143311 19206 video_data_layer.cpp:105] output data size: 50,3,16,112,112
I0130 16:44:25.760223 19209 solver.cpp:172] Creating test net (#0) specified by net file: examples/c3d_ucf101/c3d_ucf101_train_test.prototxt
I0130 16:44:25.760411 19207 solver.cpp:172] Creating test net (#0) specified by net file: examples/c3d_ucf101/c3d_ucf101_train_test.prototxt
I0130 16:44:25.760488 19209 video_data_layer.cpp:39] Opening file examples/c3d_ucf101/c3d_ucf101_test_split1_r.txt
I0130 16:44:25.760579 19207 video_data_layer.cpp:39] Opening file examples/c3d_ucf101/c3d_ucf101_test_split1_r.txt
I0130 16:44:25.803825 19206 solver.cpp:172] Creating test net (#0) specified by net file: examples/c3d_ucf101/c3d_ucf101_train_test.prototxt
I0130 16:44:25.804039 19206 video_data_layer.cpp:39] Opening file examples/c3d_ucf101/c3d_ucf101_test_split1_r.txt
I0130 16:44:25.817709 19209 video_data_layer.cpp:55] Shuffling data
I0130 16:44:25.818317 19207 video_data_layer.cpp:55] Shuffling data
I0130 16:44:25.829481 19209 video_data_layer.cpp:65] A total of 41822 video chunks.
I0130 16:44:25.832245 19207 video_data_layer.cpp:65] A total of 41822 video chunks.
I0130 16:44:25.849481 19206 video_data_layer.cpp:55] Shuffling data
I0130 16:44:25.864778 19206 video_data_layer.cpp:65] A total of 41822 video chunks.
I0130 16:44:25.886154 19209 video_data_layer.cpp:105] output data size: 5,3,16,112,112
I0130 16:44:25.907321 19207 video_data_layer.cpp:105] output data size: 5,3,16,112,112
I0130 16:44:25.982009 19206 video_data_layer.cpp:105] output data size: 5,3,16,112,112
I0130 16:44:26.843006 18643 solver.cpp:272] Solving c3d_ucf101
I0130 16:44:26.843035 18643 solver.cpp:273] Learning Rate Policy: step
I0130 16:44:26.843102 19209 blocking_queue.cpp:49] Waiting for data
I0130 16:44:26.843221 18643 solver.cpp:330] Iteration 0, Testing net (#0)
I0130 16:44:29.537828 18724 io.cpp:199] Could not read frame=177 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537876 18724 io.cpp:199] Could not read frame=178 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537880 18724 io.cpp:199] Could not read frame=179 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537884 18724 io.cpp:199] Could not read frame=180 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537888 18724 io.cpp:199] Could not read frame=181 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537890 18724 io.cpp:199] Could not read frame=182 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537894 18724 io.cpp:199] Could not read frame=183 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537896 18724 io.cpp:199] Could not read frame=184 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537899 18724 io.cpp:199] Could not read frame=185 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537902 18724 io.cpp:199] Could not read frame=186 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537905 18724 io.cpp:199] Could not read frame=187 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537909 18724 io.cpp:199] Could not read frame=188 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537910 18724 io.cpp:199] Could not read frame=189 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537915 18724 io.cpp:199] Could not read frame=190 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537919 18724 io.cpp:199] Could not read frame=191 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
I0130 16:44:29.537921 18724 io.cpp:199] Could not read frame=192 from a video file=/opt/share0/yangfan/Data/UCF101/UCF-101/Biking/v_Biking_g18_c03.avi, where num of frames=196. Use previous frame.
F0130 16:44:29.542440 18724 data_transformer.cpp:631] Check failed: n > 0 (-111 vs. 0) 
*** Check failure stack trace: ***
    @     0x7f6d8c7855cd  google::LogMessage::Fail()
    @     0x7f6d8c787433  google::LogMessage::SendToLog()
    @     0x7f6d8c78515b  google::LogMessage::Flush()
    @     0x7f6d8c787e1e  google::LogMessageFatal::~LogMessageFatal()
    @     0x7f6d8ce3602e  caffe::DataTransformer<>::Rand()
    @     0x7f6d8ce39b66  caffe::DataTransformer<>::Transform()
    @     0x7f6d8ce775a0  caffe::VideoDataLayer<>::load_batch()
    @     0x7f6d8cf23687  caffe::BasePrefetchingDataLayer<>::InternalThreadEntry()
    @     0x7f6d8cd93eb5  caffe::InternalThread::entry()
    @     0x7f6d8cd9500e  boost::detail::thread_data<>::run()
    @     0x7f6d82cac54d  thread_proxy
    @     0x7f6d72d8b6ba  start_thread
    @     0x7f6d8b0003dd  clone
    @              (nil)  (unknown)