LuanVan.vnLuận Văn
Gửi thư

Human pose and activity recognition from stereo images using probabilistic parametric inference

Luận án · Tiến sĩ · năm 2011 · đề tài tham khảo

Loại tài liệuLuận án
Bậc họcTiến sĩ
Tác giảNguyễn Đức Thắng
Cơ sở đào tạoĐại học Quốc gia TP. Hồ Chí Minh
Năm2011
NguồnThư viện số Đại học Quốc gia TP. Hồ Chí Minh · trang gốc

Tóm tắt

Human pose and activity recognition has been emerged to play critical roles in numerous areas including entertainment, robotics, surveillance, etc. Here, human pose and activity recognition refers to the task of recovering the poses of a tracked subject and identifying human activities from sequential recovered poses. Usually, human poses and activities recognized over a short duration of time provide inputs to control external devices such as computers and games. Meanwhile, a long-term human pose and activity recognition adapts to proactive computing, human health-care, and discovering human lifestyles. In order to make an approach of human pose and activity recognition to be widely used, the convenience to users, the simplicity in installation, and the reasonable prices for equipment are the main factors to be considered. However, the conventional work of capturing human motion using optical markers with multiple cameras cannot totally satisfy these requirements, leading to the absence of human pose and activity recognition systems in daily applications. Recovering human body poses and recognizing human activities from images obtained by a monocular camera may be an option. However when taking a 2-D picture of a scene with a monocular camera, we loose depth information. The appearance of a person in a 2-D image might pose many possible configurations in 3-D, that affects the results of estimating human body poses and of distinguishing alternative human activities in 3-D. In this thesis, another solution is concerned with the uses of a stereo camera: a stereo camera is a single camera consisting of two lenses to synchronously capture two images with a slight difference in the view angle from which the 3-D information of a scene can be derived to overcome the limitations of the monocular image-based approach. The thesis demonstrates an approach of how to recover 3-D human body poses from stereo images captured by a stereo camera and an application of this approach to recognize human activities with the joint angles derived from the recovered body poses. Probabilistic parametric registration with hidden variables is applied to formulate the pose estimation approach within an efficient and generalized framework. With a pair of stereo images captured by a stereo camera, first the 3-D information (i.e., 3-D data) of a human subject is computed. Separately the human body is modeled in 3-D with a set of connected ellipsoids and their joints: the joint is parameterized with kinematic angles. Then the 3-D body model and 3-D data are co-registered with the devised algorithm that works in two steps: the first step assigns the body part labels to each point of the 3-D data; the second step computes the kinematic angles to fit the 3-D human model to the labeled 3-D data. The co-registration algorithm is iterated until it converges to a stable 3-D body model that matches the 3-D human pose reflected in the 3-D data. The demonstrative results of recovering body poses in full 3-D from continuous video frames of various activities present an error of about 60–140 in the estimated kinematic angles. The proposed technique requires neither markers attached to the human subject nor multiple cameras: it only requires a single stereo camera. As an application of the proposed human pose recovery technique in 3-D, an approach of how various human activities can be recognized with the body joint angles derived from the recovered body poses is presented. The features of body joints angles are utilized over the conventional binary body silhouettes and hidden Markov models are utilized to model and recognize various human activities. The experimental results show that the presented techniques outperform the conventional human activity recognition techniques.
Bản toàn văn lưu tại thư viện Đại học Quốc gia TP. Hồ Chí Minh

Thông tin và tóm tắt ở trên lấy từ kho số mở của thư viện trường. Bản toàn văn do thư viện trường quản lý — có nơi cho đọc trực tuyến, có nơi cần tài khoản bạn đọc của trường.

Mở tại thư viện trường ↗
Dùng tài liệu tham khảo cho đúng
  • Đọc để hiểu cách người trước đặt câu hỏi, chọn phương pháp, trình bày số liệu — rồi tự làm với dữ liệu và bối cảnh của bạn.
  • Ý, số liệu, bảng biểu lấy từ tài liệu này phải trích dẫn (tác giả, năm, tên đề tài, cơ sở đào tạo).
  • Đề tài trùng tên vẫn làm được nếu khác đơn vị khảo sát, thời gian hoặc cách tiếp cận — nêu rõ điểm khác trong phần mở đầu.

Đề tài cùng ngành

Tác giả muốn gỡ, sửa thông tin hoặc bổ sung bản toàn văn: gửi yêu cầu qua trang Liên hệ, kèm đường dẫn trang này.