Human-Pose-and-Motion History

Overview

Human Pose and Motion

Scientist Approach

Eadweard Muybridge, The Galloping Horse Portfolio, 1887

Eadweard Muybridge, The Galloping Horse Portfolio, 1887

Etienne-Jules Marey, Descent of Inclined Plane,

Chronophotograph, 1882

Etienne-Jules Marey, Descent of Inclined Plane, c. 1882, Chronophotograph

E.J. Marey, Geometric Chronophotograph of the man in the black suit, 1883

E.J. Marey, Geometric Chronophotograph of the man in the black suit, 1883

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/ejm_chronophotograph01.jpg

Man in the black suit with striping and points for chronophotography, 1883

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/MAREY_SUIT_1.GIF

Etienne-Jules Marey and George Demeny “Pathological walk from in front”(1889) (the first light painting photograph)

Etienne-Jules Marey and George Demeny “Pathological walk from in front”(1889)

https://upload.wikimedia.org/wikipedia/commons/b/b5/Etienne-Jules_Marey_et_George_Demeny._Pathological_Walk_from_the_Front.jpg

E.J. Marey, Chronophotographs from "The Human Body in Action," Scientific American, 1914

E.J. Marey, Chronophotographs from "The Human Body in Action," Scientific American, 1914

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/ejm04.jpg

Stroboscope(WIP)

Artist and Choreographer’s approach

Rudolph Von Laban (1879-1958)

the first choreographer to define a movement vocabulary in the body’s relationship to “space,” “shape,” and “effort(the inner impulses)” (Hutchinson, 7).

Rudolph Von Laban “Kinesphere”

Rudolf Laban” Documentary Raitre”

https://www.youtube.com/watch?v=iQUq94KJDYM&

https://youtu.be/iQUq94KJDYM

Oscar Schlemmer “man with slanting bars” (1930)

man with slanting bars [Schlemmer, 1930]

https://www.dropbox.com/s/w22pwozy4eva1hh/Screenshot%202018-05-16%2016.50.37.png?dl=0

https://www.dropbox.com/s/1dvvt6aevmf9n5t/Screenshot%202018-05-16%2016.51.17.png?dl=0

Drawing

Giacomo Balla

Dynamism of a Dog on a Leash (1912)

Balla, Giacomo, Dynamism of a Dog on a Leash (1912)  Oil on canvas, 89.8x109.8cm,  Buffalo: Albright-Knox Art Gallery

Marcel Duchamp, Nude Descending a Staircase, No. 2, 1912

Marcel Duchamp, Nude Descending a Staircase, No. 2, 1912

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/duchampdescending.jpg

Alberto Giacometti, Femme Qui Marche, 1955

Alberto Giacometti, Femme Qui Marche, 1955, 20.4 x 6.2 cm

Film

Norman Mclaren Pas de Deux(1960)

https://www.youtube.com/watch?v=H-uwuH_Qix4&

https://youtu.be/H-uwuH_Qix4

more artists , photographer (1930~

Harold Edgerton, Frank and Lillian Gilbreth, Gjon Mili

[ ] TODO: add more embed pictures

Man Ray“Space Writing”(1935)

https://research.bowdoin.edu/surrealist-photography/files/2014/02/1987.15.jpg

Dr. Harold E. Edgerton “Golfer” 1937 https://www.moma.org/collection/works/44219

Dr. Harold E. Edgerton “Bobby Jones, high-speed photography, golfing” - 1938 (?) http://webmuseum.mit.edu/images/DIAmed/HEE-NC-38024.L.jpg

Gjion MiliPablo Picasso "draws" a centaur in the air with light, 1949.

Pablo Picasso "draws" a centaur in the air with light, 1949. Gjon Mili—The LIFE Picture Collection/Getty Images

https://timedotcom.files.wordpress.com/2012/01/150316-pablo-picasso-01.jpg?quality=85&w=861

Eliot Eliofson, Duchamp descending a staircase, photograph from Life Magazine (1952)

Eliot Eliofson, Duchamp descending a staircase, photograph from Life Magazine (1952)

Engineer / Digital Media Artist’s approach

Openendedgroup + Merce Cunningham “Biped” (1999)

http://openendedgroup.com/artworks/biped.html

ISSEY MIYAKE A-POC INSIDE(2006) animation by Euphrates

https://www.youtube.com/watch?v=aYL4TyV1YDk&

http://euphrates.jp/ISSEY-MIYAKE-A-POC-INSIDE

SATO Tetsuji + SAKAMOTO Yoichi “blank” May 16, 2009 - August 9, 2009

https://player.vimeo.com/video/274663590

https://vimeo.com/274663590 http://www.ntticc.or.jp/en/exhibitions/2009/emergencies-011-sato-tetsuji-sakamoto-yoichi/

EUPHRATES “ballet rotoscope”(2011)

https://www.youtube.com/watch?v=yzJk6ww3LD0&&t=8s

http://euphrates.jp/ballet-rotoscope

UniversalEverything “Walking City” (2014)

https://player.vimeo.com/video/85596568

https://vimeo.com/85596568

Study for Fifteen Points / I by Random International (2016)

https://player.vimeo.com/video/162979922

https://vimeo.com/162979922 https://www.random-international.com/study-for-fifteen-points-2015

Golan Levin “Ghost Pole Propagator II” (2007, 2016) http://www.flong.com/projects/gpp-ii/

https://player.vimeo.com/video/219150989

https://vimeo.com/219150989

Machine Learning

Human Motion generation, synthesis

Dynamic Response for Motion Capture Animation(2008)

https://www.youtube.com/watch?v=JzAEx6d4ow4&

https://youtu.be/JzAEx6d4ow4

Human Motion Synthesis with Optimization-Based Graphs(2011)

https://www.youtube.com/watch?v=mInQEn0UxB0&

https://youtu.be/mInQEn0UxB0

A Deep Learning Framework for Character Motion Synthesis and Editing (SIGGRAPH 2016)

https://www.youtube.com/watch?v=urf-AAIwNYk&

https://youtu.be/urf-AAIwNYk

https://www.youtube.com/watch?v=W1oRgDPxEkc&

https://youtu.be/W1oRgDPxEkc

https://www.youtube.com/watch?v=c9h9zc7uPWQ&

https://youtu.be/c9h9zc7uPWQ

Computational Foresight: Realtime Forecast of Human Body Motion(2017)

https://www.youtube.com/watch?v=TXbhXgTMtNU&

https://youtu.be/TXbhXgTMtNU Phase-Functioned Neural Networks for Character Control(2017)

https://www.youtube.com/watch?v=Ul0Gilv5wvY&&t=57s

https://youtu.be/Ul0Gilv5wvY?t=57s

SIIGGRAPH 2018 Deep Mimic paper(main video)

https://www.youtube.com/watch?v=vppFvq2quQ0&&t=6s

https://youtu.be/vppFvq2quQ0?t=6s

Motion Capture / Pose Estimation Technic

openpose https://github.com/CMU-Perceptual-Computing-Lab/openpose

https://www.youtube.com/watch?v=C1Sxk6zxWLM&

https://youtu.be/C1Sxk6zxWLM

densepose http://densepose.org

https://www.youtube.com/watch?v=Dhkd_bAwwMc&

https://youtu.be/Dhkd_bAwwMc

PoseNet

Real-time Human Pose Estimation in the Browser with TensorFlow.js https://medium.com/tensorflow/real-time-human-pose-estimation-in-the-browser-with-tensorflow-js-7dd0bc881cd5

https://cdn-images-1.medium.com/max/1200/1*Gsx7MLBj2LKiaDsab0iNjg.gif

PoseNet https://github.com/tensorflow/tfjs-models/tree/master/posenet

Live Demo https://storage.googleapis.com/tfjs-models/demos/posenet/camera.html

RADiCAL

AI-powered 3D motion capture, minus the suits and hardware. https://getrad.co/#register

https://www.dropbox.com/s/bitz8pdrn5pxf71/Screenshot%202018-05-16%2017.29.42.png?dl=0

MonoPerfCap: Human Performance Capture from Monocular Video

http://gvv.mpi-inf.mpg.de/projects/wxu/MonoPerfCap/ https://arxiv.org/abs/1708.02136

https://www.dropbox.com/s/bsu60ot8tmhh79q/Screenshot%202018-05-16%2017.29.20.png?dl=0

Military

https://www.youtube.com/watch?v=D7I4qf-HlEI&

https://youtu.be/D7I4qf-HlEI

https://www.youtube.com/watch?v=zYypJPJipYc&

https://youtu.be/zYypJPJipYc

Soccer On Your Tabletop http://grail.cs.washington.edu/projects/soccer/

https://www.youtube.com/watch?v=eRGAB4QBS6U&

https://youtu.be/eRGAB4QBS6U

Bibiography

Golan Levin Audiovisual Software Art: A Partial History,9 May 2009

http://www.flong.com/texts/essays/see_this_sound_old/#case2

THE SPACE OF THE FALL, On Dance, Architecture, Bodily Perspective and Gravity

http://home.hccnet.nl/j.w.nijenhuis/artikel/TheSpaceoftheFallonDancea.html

Etienne-Jules Marey archive http://www.expo-marey.com/ANGLAIS/home.html

Eadweard Muybridge Works Online** http://www.artcyclopedia.com/artists/muybridge_eadweard.html

UCBerkeley “ HUMAN FACTORS AND EXISTENTIAL PHENOMENOLOGY”

http://goldberg.berkeley.edu/courses/S06/IEOR-QE-S06/images.html

MOMA Collection

https://www.moma.org/collection/works/49635?artist_id=1681

human-pose-detection by samim

https://medium.com/@samim/human-pose-detection-51268e95ddc2

light-painting-history

http://lightpaintingphotography.com/light-painting-history/

edgerton digital collections

https://edgerton-digital-collections.org

ラバン身体動作表現理論について

https://staff.aist.go.jp/toru-nakata/shintairon.html

a brief history of motion capture in the movies

http://www.ign.com/articles/2014/07/11/a-brief-history-of-motion-capture-in-the-movies

https://twitter.com/kcimc/status/1004428337597505536

https://twitter.com/kcimc/status/1004428337597505536

https://twitter.com/kcimc/status/1004427682883366912

https://twitter.com/kcimc/status/1004427682883366912

Owner
Daito Manabe
old school youtuber
Daito Manabe
Code release for Local Light Field Fusion at SIGGRAPH 2019

Local Light Field Fusion Project | Video | Paper Tensorflow implementation for novel view synthesis from sparse input images. Local Light Field Fusion

1.1k Dec 27, 2022
A toolkit for making real world machine learning and data analysis applications in C++

dlib C++ library Dlib is a modern C++ toolkit containing machine learning algorithms and tools for creating complex software in C++ to solve real worl

Davis E. King 11.6k Jan 01, 2023
Machine Learning Privacy Meter: A tool to quantify the privacy risks of machine learning models with respect to inference attacks, notably membership inference attacks

ML Privacy Meter Machine learning is playing a central role in automated decision making in a wide range of organization and service providers. The da

Data Privacy and Trustworthy Machine Learning Research Lab 357 Jan 06, 2023
Deep Halftoning with Reversible Binary Pattern

Deep Halftoning with Reversible Binary Pattern ICCV Paper | Project Website | BibTex Overview Existing halftoning algorithms usually drop colors and f

Menghan Xia 17 Nov 22, 2022
N-gram models- Unsmoothed, Laplace, Deleted Interpolation

N-gram models- Unsmoothed, Laplace, Deleted Interpolation

Ravika Nagpal 1 Jan 04, 2022
TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation, CVPR2022

TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation Paper Links: TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentati

Hust Visual Learning Team 253 Dec 21, 2022
HIVE: Evaluating the Human Interpretability of Visual Explanations

HIVE: Evaluating the Human Interpretability of Visual Explanations Project Page | Paper This repo provides the code for HIVE, a human evaluation frame

Princeton Visual AI Lab 16 Dec 13, 2022
City Surfaces: City-scale Semantic Segmentation of Sidewalk Surfaces

City Surfaces: City-scale Semantic Segmentation of Sidewalk Surfaces Paper Temporary GitHub page for City Surfaces paper. More soon! While designing s

14 Nov 10, 2022
The PASS dataset: pretrained models and how to get the data - PASS: Pictures without humAns for Self-Supervised Pretraining

The PASS dataset: pretrained models and how to get the data - PASS: Pictures without humAns for Self-Supervised Pretraining

Yuki M. Asano 249 Dec 22, 2022
Lightweight Cuda Renderer with Python Wrapper.

pyRender Lightweight Cuda Renderer with Python Wrapper. Compile Change compile.sh line 5 to the glm library include path. This library can be download

Jingwei Huang 53 Dec 02, 2022
Official Repository for Machine Learning class - Physics Without Frontiers 2021

PWF 2021 Física Sin Fronteras es un proyecto del Centro Internacional de Física Teórica (ICTP) en Trieste Italia. El ICTP es un centro dedicado a fome

36 Aug 06, 2022
Deep-Learning-Book-Chapter-Summaries - Attempting to make the Deep Learning Book easier to understand.

Deep-Learning-Book-Chapter-Summaries This repository provides a summary for each chapter of the Deep Learning book by Ian Goodfellow, Yoshua Bengio an

Aman Dalmia 1k Dec 27, 2022
Running AlphaFold2 (from ColabFold) in Azure Machine Learning

Running AlphaFold2 (from ColabFold) in Azure Machine Learning Colby T. Ford, Ph.D. Companion repository for Medium Post: How to predict many protein s

Colby T. Ford 3 Feb 18, 2022
Single Image Random Dot Stereogram for Tensorflow

TensorFlow-SIRDS Single Image Random Dot Stereogram for Tensorflow SIRDS is a means to present 3D data in a 2D image. It allows for scientific data di

Greg Peatfield 5 Aug 10, 2022
StyleGAN2-ada for practice

This version of the newest PyTorch-based StyleGAN2-ada is intended mostly for fellow artists, who rarely look at scientific metrics, but rather need a working creative tool. Tested on Python 3.7 + Py

vadim epstein 170 Nov 16, 2022
Air Quality Prediction Using LSTM

AirQualityPredictionUsingLSTM In this Repo, i present to you the winning solution of smart gujarat hackathon 2019 where the task was to predict the qu

Deepak Nandwani 2 Dec 13, 2022
GAN-STEM-Conv2MultiSlice - Exploring Generative Adversarial Networks for Image-to-Image Translation in STEM Simulation

GAN-STEM-Conv2MultiSlice GAN method to help covert lower resolution STEM images generated by convolution methods to higher resolution STEM images gene

UW-Madison Computational Materials Group 2 Feb 10, 2021
a Lightweight library for sequential learning agents, including reinforcement learning

SaLinA: SaLinA - A Flexible and Simple Library for Learning Sequential Agents (including Reinforcement Learning) TL;DR salina is a lightweight library

Facebook Research 405 Dec 17, 2022
Implement A3C for Mujoco gym envs

pytorch-a3c-mujoco Disclaimer: my implementation right now is unstable (you ca refer to the learning curve below), I'm not sure if it's my problems. A

Andrew 70 Dec 12, 2022
TensorFlow-based implementation of "ICNet for Real-Time Semantic Segmentation on High-Resolution Images".

ICNet_tensorflow This repo provides a TensorFlow-based implementation of paper "ICNet for Real-Time Semantic Segmentation on High-Resolution Images,"

HsuanKung Yang 406 Nov 27, 2022