The Blog

Why? “Facial Expression”

The Theoretical Context

An Visualization Method of Music Impression in Facial Expression to Represent Emotion.
In an attempt to provide a clear assessment of the theory that a physical facial change, involving only certain facial muscles, can result in an emotion. The visualisation method of music impression in facial expression to represent emotion. This method can measure the relationship between each impression of music data and face expression. This method can composite facial expression corresponding to impressions of a music data. Facial expression is one of nonverbal behaviors. The facial expression is important as media that convey various emotions effectively.

Work in progress And the Final Work “Facial Expression”

My attempt is to demonstrate emotions as well as individual muscles actions by using clean sounding instruments, and then we listen to it in order to incorporate different feelings and emotions to the character.

This are some Screen Shot of my work.

First image shows 3D model of human facial muscles. Cinema 4D and sound reactive.

Screen Shot 2013-05-30 at 17.26.04

 

The Facial Muscles, and in particular those in the lips, help to shape the sound and air stream into recognizable speech. These muscles move the face in response to our thoughts, feelings, emotions and impulses. Actors work very carefully to learn how to isolate each muscle. It is useful to learn to recognize the various muscles in order to better isolate them, so that any extraneous movement is eliminated and the muscles used are those desired. Also by recognizing the muscles’ shape, it is easier to understand how these muscles move the face.

Screen Shot 2013-05-30 at 17.27.02

Screen shot of my work using Cinema 4D, linking sound with facial featureusing XPresso.

 

This is the final video that i have finished.

Facial Expression from Shkelzen Kernaja on Vimeo.

Facial Expression in VFX focusing on sound/adding Sound.
I am interest how facial muscles react to the sound using different instruments and how muscle work. One of the works that influenced me is Duchenne of Boulogne, Duchenne wanted to determine how the muscles in the human face produce facial expressions which he believed to be directly linked to the soul of man.

Cinema 4d and XPresso

If you think is cool Share it with friends.
many thanks

 

 

final Research “Facial Expression”

I have selected and show some of the artist that is making music with facial expression.

 

It seems everyone these days is looking for new ways to interact with computers and information. One might even say that we’re entering into “the age of the interface,” where actions and interactions are going to be guided by increasingly invisible and intuitive ways of meshing two environments together.

 

Screen Shot 2013-05-30 at 17.53.36

Jonathan Hammond turns his face into a musical instrument.https://vimeo.com/26475997

Manabe’s latest experiment uses myoelectric (an electrical impulse that results in the contraction of muscle fibres) sensors to create a drum machine out of a human body. Attaching touch sensors to his hands, Manabe sends electric pulses to his friend, and in turn generates sound and makes his friend’s face twitch in the process.

Screen Shot 2013-05-30 at 18.39.38

Electric stimulus to face -test3 ( Daito Manabe )

https://www.youtube.com/watch?v=YxdlYFCp5Ic&feature=player_embedded

once you start watching the video, its shows the use keyboard to trigger the instruments via Crews’ muscles, creating your own song, play Terry Crews like an instrument!

 

Screen Shot 2013-05-30 at 18.47.24

Old Spice Muscle Music https://vimeo.com/47875656

Work in progress “Facial Expression”

I have been experimenting by using kinect and faceshift  which “analyses the face motions of an actor, and describes them as a mixture of basic expressions, plus head orientation and gaze. This description is then used to animate virtual characters for use in movie or game production.”

Print screen

faceshift02

 

I have recorded my motion and displayed all of them at the same time.

Screen Shot 2013-04-09 at 20.35.41

There was another thing that i did is that i used motion tracking data to create and abstract pice which it was inspired from the flower “Venus flytrap”

Screen Shot 2013-04-08 at 00.53.08

Facial Expression research

A study of facial expression in Visual Effect, Focusing on sound/ adding sound.
Can 3D workflow effectively inform how sound stimulate facial Anatomy?

I am interest how facial muscles react to the sound using different instruments and how muscle work. One of the works that influenced me is Duchenne of Boulogne, Duchenne wanted to determine how the muscles in the human face produce facial expressions which he believed to be directly linked to the soul of man.

Certain sounds have different effects from other ones. We respond differently to a Mozart sonata than to a rock, and hip pop concert. Some proper names seem soft and pleasing to us; others seem harsh and unpleasant. While our responses may be partly due to past experiences, our personal associations with different sounds, there are good reasons to suppose that we also have innate responses to certain sounds.

 

 

 

Dr. Duchenne of Bologna, a nineteenth-century French scientist, became famous for his explorations of muscle fuction using electrical stimulation. In his book Mecanisme de la physionomie humaine, he illustrated the actions of

stimulating

many of the facial muscles by photographing subjects whose face he ‘stimulated’ with electrified needles (he said to be very unpleasant feeling).

Dr. Duchenne wanted to determine how the muscles in the human face produce facial expressions, which he believed to be directly linked to the soul of man.

Duchenne used this technique to attempt to demonstrate emotions as well as individual muscles actions. Here multiple electrodes are employed, applied to both the neck and the forehead, to illustrate the expression of fear. The muscles activated include the corrugator, the frontalis (forehead), and risorius and platysma (neck)

He is known, in particular, for the way he triggered muscular contractions with electrical probes, recording the resulting distorted and often grotesque expressions with the recently invented camera. He published his findings in 1862, together with extraordinary photographs of the induced expressions, in the book The Mechanism of Human Physiognomy (Mecanisme de la physionomie Humaine).

 

dus2b

Screen Shot 2013-06-01 at 17.56.16

The way the facial muscles are mixed in with everything else under the skin made life very difficult early anatomist trying to map out the muscles of the face. The famous anatomy of Vesalius, published in the late 1500s shows the facial muscles in vague and misleading way. Other muscular systems of the body, large and easier to dissect, were more accurately portrayed. Nearly a century earlier, another pioneer anatomist had patiently explored and diagrammed the facial muscles in beautiful, accurate drawings. But the anatomical drawings of Leonardo da Vinci, like so much of his scientific and artwork were by time of Vesalius scattered in private collections and unknown

to the world at large. The anatomical text Leonardo intended to publish had never been realized.
In Leonardo’s case, the result of all his meticulous effort was not just anatomical drawings. The men in his battles scenes, just like the women in his portrait, have faces more real, and more alive, than any that had appeared in painting before. Science in the service of art led to a master of expression. Though Leonardo and others had mapped out the facial muscles, the function of the various muscles were not well understood until the nineteenth century. In the mid-nineteenth century, Duchenne of Boulogne found that slight electrical jolts to various point on the face caused the muscles to contract individually. His photographs of electrically induced smiles and snarls are both strange and compelling; his descriptions of which muscles do what, and important advance.

The question of why we smile and snarl was addressed by a man more famous for his work in another field. Charles Darwin’s book on facial expression, The Expression, The Expression of emotion in Man and Animals (1872), remains to this day probably the single best book on the subject. Making use of the work of Duchenne and others, Darwin speculated about why we make he face we do and whether they are specific or universal.

In recent times there has been a resurgence of interest in facial expression, led not by artist or anatomist but by psychologists interested in the real of nonverbal communication.

Final Stereoscopic titling proposals

 

Title sequence in anaglyph – four shots from Shkelzen Kernaja on Vimeo.

Titling is created by Catherine Lui – 2rd Visual Effects

Titling is created by Victoria Smith – 2nd Visual Effects

Title sequence in anaglyph from VBadwolf on Vimeo.

The work that Victoria and Catherine has created are interesting but they could have done more to improve the titling and learn how to use the program properly. With the time we had as a group we were able to produce a professional piece of work with my work. If we had more time i could have helped Catherine and Victoria complete their contributions to a much higher standard.  The work produced are all very interesting and varied which means that by having a diverse group makes for an even more interesting results.

 

 

Stereoscopic titling proposals

Lecturer Mike would like the group to come up with another piece of work in order to complete the unit successfully to shoot a scene of a location of you group choice, The 4 group members agreed on Stereoscopic titling proposals. 3 from me and 1 from Catherine and 1 from Victoria. The Producer and Director agreed that the group should meet at the College in January 2013 with ideas on what other 3D Stereoscopic project they wish to carry out and what visual effects they want to create, for the next group project. The Producer has asked each member to come up with an idea.

My ideas where to create one Ident in motion graphic style using a “word from a book, magazine, newspaper’ and ‘text, number’ that can be used in the scene, this video where very inspired and i wanted to create something Like “MTV ‘Organic’ – Umeric

MTV ‘Organic’ – Umeric from Umeric on Vimeo.

there was a problem that i could not create any motion graphic tv ident because i had to work in my previous work that i did “Pave the Way”

Me and Diepiri MacPepple-Jaja – The Producer we chose a 4 different location to shoot the scene in the Libray at Ravensbourne

this are some screen shot of the video that we shoot

library

library

 

Screen Shot 2013-01-25 at 23.25.47

 

once we finished shooting the library scene i was the only one in my group that i had the knowledgment  to track in Boujou 5 it which is called ‘match moving’ . ”Match moving” is a cinematic technique that allows the insertion of computer graphics into Live-action footage with correct position, scale, orientation, and motion relative to the photographed objects in the shot.

This is screen shot of Boujou 5 that was able to tracking successfully and i had to Export the camera footage to Cinema 4D that allows  ’Catherine Lui – 2rd Visual Effects’ to work and in Autodesk Maya that allows Victoria Smith – 3nd Visual Effects to work.

tracking

 

 

final scene “Pave the Way”

once i send all render video (1920 x 1080 25f) (left and right) separately to Caroline 

 

 

this are final videos that Caroline fixed in Mystica

MASTER EDIT – slow mo Title in anaglyph- font normal size ONLINE anaglyph Copy from Shkelzen Kernaja on Vimeo.

 

MASTER EDIT – slow mo Title in side by side – font normal size ONLINE from Shkelzen Kernaja on Vimeo.

Group Work- Creating 3D Stereoscopic “Ident”

3D-Avatar-movie
Avatar marked a ground-breaking moment in the development of 3D filmmaking.

It’s three years since audiences around the world swarmed into cinemas to see James Cameron’s Avatar. It rapidly became the biggest grossing film of all time, in part because of its ground-breaking digital 3D technology.

In our group are 4 members: me, Shkelzen Kernaja (Artistic Director/Visual Effects), Caroline Orme (Director), Catherine Lui (DP/Visual Effects), Diepiri MacPepple-Jaja (Producer). We chose to create a 3D Stereoscopic titling for one of our members film the Jurassic Coast Project,  which is a 3 D Stereoscopic film of the Jurassic Coast presented by Artist and Lecturer Jeremy Gardner which is in Post Production with Caroline Orme our Director.

 

My task was to create titling  for Jurassic Coast Project “Pave the Way”.

This is A screen shot of the footage that caroline shot with her crew which the doing a documentary for Jeremy Gardiner which is going to have exhibition.

scene

 

A storyboard was created by Caroline to help me to create the animation “Pave the Way”

story board

 

Then talking to ‘Caroline Orme – The Director/Editor’ she wanted to add texture texture of the titles needed to resemble the stone found on the Jurassic Coast.

jpeg Photos of stone from quarry (e.g. Purbeck, Limestone and Purbeck stone) was sent to me to be used for compositing onto the 3D titles “Pave the Way’.

pic of stone from quarry

 

 

3d texture

This are some screen shot of “Pave” in 3D program of Cinema 4D.

pave

I also had to use and learn some 3d stereoscopy  which it was given in the end to Caroline,

the image belo is in 3d stereoscopy in ‘red and blue’

pave in 3d

 I have render all the final videos in Alpha channel which i gave to Caroline, then film can then be edited using Mystica, After Effects or Nuke.

screen shot “pave”

pave

 

Why ? “Movement and Motion”

I want to explore more of “Movement and Motion” through movement, motion, philosophy, and science through image, text, and sound. Have you ever stopped to think how do we move? Why can see the effect of movement and motion that we only feel? How is it possible to move so well and then become older and become stiffer, losing balance, coordination, and motion? Giant historical figures from Aristotle, Galen, Da Vinci, or Galileo have been obsessed with motion, specifically with human motion. I want to take the research of photographer’s painters and sculptures the experiment to the next level to create and interactive, video and animation.

I am using this project ”Movement and Motion”  to PGO1.