Free Republic
Browse · Search
General/Chat
Topics · Post Article

This thread has been locked, it will not receive new replies.
Locked on 07/13/2019 12:50:40 PM PDT by Jim Robinson, reason:

childishness



Skip to comments.

Identifying perceived emotions from people's walking style
Tech Xplore ^ | July 12, 2019 | Ingrid Fadelli - Tech Xplore

Posted on 07/12/2019 11:25:48 PM PDT by ETL

A team of researchers at the University of North Carolina at Chapel Hill and the University of Maryland at College Park has recently developed a new deep learning model that can identify people's emotions based on their walking styles.

Their approach, outlined in a paper pre-published on arXiv, works by extracting an individual's gait from an RGB video of him/her walking, then analyzing it and classifying it as one of four emotions: happy, sad, angry or neutral.

"Emotions play a significant role in our lives, defining our experiences, and shaping how we view the world and interact with other humans," Tanmay Randhavane, one of the primary researchers and a graduate student at UNC, told TechXplore.

"Perceiving the emotions of other people helps us understand their behavior and decide our actions toward them. For example, people communicate very differently with someone they perceive to be angry and hostile than they do with someone they perceive to be calm and contented."

Most existing and identification tools work by analyzing facial expressions or voice recordings.

However, past studies suggest that body language (e.g., posture, movements, etc.) can also say a lot about how someone is feeling.

Inspired by these observations, the researchers set out to develop a tool that can automatically identify the perceived emotion of individuals based on their walking style.

"The main advantage of our perceived emotion recognition approach is that it combines two different techniques," Randhavane said.

"In addition to using , our approach also leverages the findings of psychological studies. A combination of both these techniques gives us an advantage over the other methods."

The approach first extracts a person's walking gait from an RGB video of them walking, representing it as a series of 3-D poses. Subsequently, the researchers used a long short-term memory (LSTM) recurrent neural network and a random forest (RF) classifier to analyze these poses and identify the most prominent emotion felt by the person in the video, choosing between happiness, sadness, anger or neutral.

The LSTM is initially trained on a series of deep features, but these are later combined with affective features computed from the gaits using posture and movement cues. All of these features are ultimately classified using the RF classifier.

Randhavane and his colleagues carried out a series of preliminary tests on a dataset containing videos of people walking and found that their model could identify the perceived emotions of individuals with 80 percent accuracy. In addition, their approach led to an improvement of approximately 14 percent over other perceived emotion recognition methods that focus on people's walking style.

"Though we do not make any claims about the actual emotions a person is experiencing, our approach can provide an estimate of the perceived emotion of that walking style," Aniket Bera, a Research Professor in the Computer Science department, supervising the research, told TechXplore.

"There are many applications for this research, ranging from better human perception for robots and autonomous vehicles to improved surveillance to creating more engaging experiences in augmented and virtual reality."

Along with Tanmay Randhavane and Aniket Bera, the research team behind this study includes Dinesh Manocha and Uttaran Bhattacharya at the University of Maryland at College Park, as well as Kurt Gray and Kyra Kapsaskis from the psychology department of the University of North Carolina at Chapel Hill.

To train their deep learning model, the researchers have also compiled a new dataset called Emotion Walk (EWalk), which contains videos of individuals walking in both indoor and outdoor settings labeled with perceived emotions.

In the future, this dataset could be used by other teams to develop and train new emotion recognition tools designed to analyze movement, posture, and/or gait.

"Our research is at a very primitive stage," Bera said.

"We want to explore different aspects of the body language and look at more cues such as facial expressions, speech, vocal patterns, etc., and use a multi-modal approach to combine all these cues with gaits.

Currently, we assume that the walking motion is natural and does not involve any accessories (e.g., suitcase, mobile phones, etc.).

As part of future work, we would like to collect more data and train our deep-learning model better. We will also attempt to extend our methodology to consider more activities such as running, gesturing, etc."

According to Bera, perceived emotion recognition tools could soon help to develop robots with more advanced navigation, planning, and interaction skills.

In addition, models such as theirs could be used to detect anomalous behaviors or walking patterns from videos or CCTV footage, for instance identifying individuals who are at risk of suicide and alerting authorities or healthcare providers.

Their model could also be applied in the VFX and animation industry, where it could assist designers and animators in creating virtual characters that effectively express particular emotions.

Explore further

Exploring people's perception of geometric features, personalities and emotions in videos with virtual humans


TOPICS: Chit/Chat; Science; Society
KEYWORDS:
Navigation: use the links below to view more comments.
first previous 1-2021-4041-60 last
To: ETL

Oh. You gone spam nuclear. Again.


41 posted on 07/13/2019 11:52:38 AM PDT by Berlin_Freeper (Congratulations to the USWNT on winning the World Cup! America is proud of you all!- President Trump)
[ Post Reply | Private Reply | To 39 | View Replies]

To: ETL

Congratulations to the U.S. Women’s Soccer Team on winning the World Cup! Great and exciting play. America is proud of you all!— Donald J. Trump (@realDonaldTrump) July 7, 2019

Congratulations to the World Champion U.S. Women’s Soccer Team! Our whole country is so proud! 🇺🇸🇺🇸🇺🇸— Vice President Mike Pence (@VP) July 7, 2019

Congratulations to the @USWNT and thanks for giving Americans yet another reason to be proud over the Fourth of July weekend by bringing home the World Cup. The Senate sends our congratulations for your grit, teamwork, and talent.— Leader McConnell (@senatemajldr) July 8, 2019


42 posted on 07/13/2019 11:59:00 AM PDT by Berlin_Freeper (Congratulations to the USWNT on winning the World Cup! America is proud of you all!- President Trump)
[ Post Reply | Private Reply | To 39 | View Replies]

To: Berlin_Freeper
"I love watching women's soccer," he said in the Oval Office. "They’re really talented." - President Trump

And you seriously believe he meant it. That he wasn't simply doing the PC-correct thing, in, as president of the United States, showing public support for the US team, despite their being led by an anti-American, anti-flag POS. One you clearly have no problems with, and even attempted to defend on at least one of the women soccer threads you posted.

You actually think that a guy like Trump genuinely enjoys watching women's soccer? I suppose it's possible, but I strongly doubt it. Because he's always making compliments and giving praise to things and people he obviously feels the opposite way about. It's just part of his "Art of the Deal" way of doing things.

43 posted on 07/13/2019 12:01:30 PM PDT by ETL (REAL Russia collusion! Plus MUCH more!! Click ETL...)
[ Post Reply | Private Reply | To 38 | View Replies]

To: ETL

Were you going to make a post about the study of walks, or were you just filling the empty minutes of your pathetic life?


44 posted on 07/13/2019 12:02:08 PM PDT by Berlin_Freeper (Congratulations to the USWNT on winning the World Cup! America is proud of you all!- President Trump)
[ Post Reply | Private Reply | To 39 | View Replies]

To: ETL

I covered this already.

You are calling President Trump a cheap political whore whose word we can’t trust about anything.

Go back and read it.


45 posted on 07/13/2019 12:05:30 PM PDT by Berlin_Freeper (Congratulations to the USWNT on winning the World Cup! America is proud of you all!- President Trump)
[ Post Reply | Private Reply | To 43 | View Replies]

To: Berlin_Freeper

“It was a little nod to Kaepernick and everything that he’s standing for right now."

--Berlin_Freeper's hero, anti-patriot Megan Rapinoe
46 posted on 07/13/2019 12:06:23 PM PDT by ETL (REAL Russia collusion! Plus MUCH more!! Click ETL...)
[ Post Reply | Private Reply | To 38 | View Replies]

To: ETL

I posted that Like President Trump I don’t agree with Rapinoe off the playing field.
What else can you invent weirdo?


47 posted on 07/13/2019 12:08:18 PM PDT by Berlin_Freeper (Congratulations to the USWNT on winning the World Cup! America is proud of you all!- President Trump)
[ Post Reply | Private Reply | To 46 | View Replies]

To: ETL
Identifying perceived emotions from people's walking style
ETL filling the empty minutes of his hate filled pathetic life.
48 posted on 07/13/2019 12:10:25 PM PDT by Berlin_Freeper (Congratulations to the USWNT on winning the World Cup! America is proud of you all!- President Trump)
[ Post Reply | Private Reply | To 46 | View Replies]

To: ETL

49 posted on 07/13/2019 12:11:51 PM PDT by Larry Lucido
[ Post Reply | Private Reply | To 1 | View Replies]

To: ETL

professional


50 posted on 07/13/2019 12:12:58 PM PDT by morphing libertarian ( Use Comey's Report, Indict Hillary now; build Kate's wall. --- Proud Smelly Walmart Deplorable)
[ Post Reply | Private Reply | To 2 | View Replies]

To: Berlin_Freeper
You are calling President Trump a cheap political whore whose word we can’t trust about anything.

What a disingenuous punk you are. You must have had your butt whipped a lot growing up. Were you fascinated with women's soccer as a boy? Or did the fascination develop later in life?

51 posted on 07/13/2019 12:14:16 PM PDT by ETL (REAL Russia collusion! Plus MUCH more!! Click ETL...)
[ Post Reply | Private Reply | To 45 | View Replies]

To: Larry Lucido

Ratso Rizzo, in a “New York state of mind”.


52 posted on 07/13/2019 12:15:41 PM PDT by ETL (REAL Russia collusion! Plus MUCH more!! Click ETL...)
[ Post Reply | Private Reply | To 49 | View Replies]

To: ETL

53 posted on 07/13/2019 12:17:19 PM PDT by Larry Lucido
[ Post Reply | Private Reply | To 1 | View Replies]

To: morphing libertarian

Re: professional

Yes, I believe he was president of the Silly Walks Institute at the time.


54 posted on 07/13/2019 12:17:31 PM PDT by ETL (REAL Russia collusion! Plus MUCH more!! Click ETL...)
[ Post Reply | Private Reply | To 50 | View Replies]

To: Larry Lucido

Looks like he’s playing a little “pocket pool” as he’s dancing, or whatever it is that he’s doing there.


55 posted on 07/13/2019 12:19:24 PM PDT by ETL (REAL Russia collusion! Plus MUCH more!! Click ETL...)
[ Post Reply | Private Reply | To 53 | View Replies]

To: ETL

Hey, it’s Christopher Walken, walkin’! (Sort of).


56 posted on 07/13/2019 12:20:46 PM PDT by Larry Lucido
[ Post Reply | Private Reply | To 55 | View Replies]

To: ETL
You are calling President Trump a cheap political whore whose word we can’t trust about anything.
What a disingenuous punk you are. You must have had your butt whipped a lot growing up. Were you fascinated with women's soccer as a boy? Or did the fascination develop later in life?
I don't recall someone making a quote from a post and then respond with nothing but meaningless insults.

This is something you have done at least twice in this thread alone.

Sorry I destroyed your psyche. But really all I did was post a sexy woman gif and then responded to you with: USA! USA! USA!

57 posted on 07/13/2019 12:21:24 PM PDT by Berlin_Freeper (Congratulations to the USWNT on winning the World Cup! America is proud of you all!- President Trump)
[ Post Reply | Private Reply | To 51 | View Replies]

To: ETL

MINISTRY of Silly Walks


58 posted on 07/13/2019 12:25:43 PM PDT by morphing libertarian ( Use Comey's Report, Indict Hillary now; build Kate's wall. --- Proud Smelly Walmart Deplorable)
[ Post Reply | Private Reply | To 54 | View Replies]

To: Berlin_Freeper
(again you are welcome for my post)

I agree it was a good idea, and a good post. For both I belatedly thank you.

However, you know what the situation is between us regarding that US women's soccer team thread you posted a few weeks ago, where you made at least one really stupid excuse in defense of her actions, saying something like, "who knows why she's doing what she's doing?".

BTW, I post threads like this often as fodder for jokes. To provide an opportunity for people to come up with humorous responses. To hopefully bring a few smiles.

Anyway, getting back to the one good thing you've posted in practically all the time I've been familiar with you as member...


"Identifying perceived emotions from people's walking style"


59 posted on 07/13/2019 12:40:45 PM PDT by ETL (REAL Russia collusion! Plus MUCH more!! Click ETL...)
[ Post Reply | Private Reply | To 38 | View Replies]

To: ETL
....you posted a few weeks ago, where you made at least one really stupid excuse in defense of her actions, saying something like, "who knows why she's doing what she's doing?".
Wasn't stupid at all. Someone pointed out that Rapinoe only stopped kneeling because a rule was made against it. Which I said shows it is more important to Rapinoe to play soccer than to kneel. So who knows what she is protesting - which I have seen conservative opinion pieces basically saying also.

LGBTQ? SCOTUS sided with them,
Prison reform? POTUS did that.

60 posted on 07/13/2019 12:48:17 PM PDT by Berlin_Freeper (Congratulations to the USWNT on winning the World Cup! America is proud of you all!- President Trump)
[ Post Reply | Private Reply | To 59 | View Replies]


Navigation: use the links below to view more comments.
first previous 1-2021-4041-60 last

Disclaimer: Opinions posted on Free Republic are those of the individual posters and do not necessarily represent the opinion of Free Republic or its management. All materials posted herein are protected by copyright law and the exemption for fair use of copyrighted works.

Free Republic
Browse · Search
General/Chat
Topics · Post Article

FreeRepublic, LLC, PO BOX 9771, FRESNO, CA 93794
FreeRepublic.com is powered by software copyright 2000-2008 John Robinson