Join us to participate in the upcoming 2019 City:One Challenge. 

Predict Pedestrian Behavior

Developing solutions through AI to predict/anticipate pedestrian behavior in the urban environment resulting in improved pedestrian safety.

Photo of Intvo LLC
4 2

Written by

Autonomous vehicles have the potential to create a world with fewer limitations, greater accessibility, and safer roads. As the automotive industry develops autonomous vehicles, one of the major hurdles they face is ensuring the safety of road users. Greater distractions, especially from digital technologies, are responsible for a recent rise in pedestrian deaths. Here, at Intvo, we are developing artificial intelligence that predicts pedestrian behaviors. Our product goes beyond processing physical movement vectors in space. It is designed with human factors in mind, allowing it to account for body language and human reflexes to decode both intended behaviors and slips that occur as the result of distracted pedestrians.

Intvo’s software is innovative, unique, and most importantly, its core purpose is improving safety and saving lives. Efficient and safe navigation in traffic requires cognitive skills, risk prediction ability, and ethical decision-making. Humans already possess these skills and abilities. We are developing software that will resemble the abilities of the human brain and even outperform them.

Our Vision is to strengthen the safety, confidence, and trust for self-driving vehicles with the help of AI. We are striving to ensure a safe road environment and ease the lives of all individuals. Our smart vision software pushes the boundaries of autonomous technology in the existing market and enhances the robustness of the autonomous vehicle’s vision.

How will your solution benefit residents, workers, or visitors in the Michigan Central Station impact area? (1,000 characters)

Intvo’s software is innovative, unique, and most importantly, its core purpose is improving safety and saving lives. Efficient and safe navigation in traffic requires cognitive skills, risk prediction ability, and ethical decision-making. Humans already possess these skills and abilities. We are developing software that will resemble the abilities of the human brain and even outperform them. The current state of the art in the field of artificial intelligence focuses on detections, tracking, and classifications. Intvo goes further by building multiple behavioral models based on the analysis of the previously collected data via image processing and by using deep learning. The behavioral models contain multiple models and each of those models covers a different aspect as interaction, distractions, awareness, etc. After the behavioral models are built, Intvo can make predictions based on them. The final step in our algorithm assigns a risk assessment

Describe your solution's stage of development

  • Pilot - you have implemented your solution in a real-world scenario

Insights from previous testing (500 characters)

Leading into customer engagement, Intvo has confirmed pilot partnerships with the University of Michigan Transportation Research Institute, and the Toledo Area Transit Authority to gather data and test driver alert systems that will lead to potential vehicle interaction in the future.

Tell us about your team or organization (500 characters)

Intvo is a startup based in Ann Arbor, MI with an enthusiastic team comprised of the following key members: Assam Alzookery – Founder & CEO Sharena Rice – Senior Behavioral Scientist Brian Korzynski – Senior Data Scientist Anthony Bozzini– Head of Business Development Joaquin Nuno-Whelan - Strategy Advisor

Size of your team or organization

  • 2-10

Team or Organization URL

https://intvo.com

Are you submitting as a student team?

  • No

Funding Request

  • $150,000

Rough Budget (500 characters)

Deploying this innovation will require a rough budget of $150K which will be used for software, hardware, installation, testing and staff cost.

Describe how you would pilot your idea (1000 characters)

We plan to achieve this project’s goal in two objectives, summarized below.: Objective 1: We will spend approximately 150 hours collecting data which will be used for further testing in our lab. Intvo will use the collected data to retrain our behavioral model. The software will then be tested at MCity for 85% or greater accuracy before implementing it. Objective 2: after 4 months, Intvo will deploy its pedestrian prediction software and hardware. Intvo software will perform pedestrian path prediction that will be sent to the Roadside Units (RSU). The RSU will construct and broadcast the pedestrian safety message (PSM) to any connected vehicle and inform/warn the driver appropriately. Intvo’s team will test the software’s accuracy on the infrastructure. The software will be constantly monitored by the Intvo team and on-site checks will be conducted once a week.

Describe how you would measure the success of your pilot (1000 characters)

The measured system false-positive performance baseline is 85% accuracy. We will decrease the false positives to the level agreed to by the team with a target of 90% accuracy. We will check with the following parameters in mind: Frequency - with each time the simulation model is run. Resolution - in use cases including day, night, weather, etc. Accuracy - using false positive criteria that partner and Intvo agree upon. Tools - recorded video and shared classification sessions with partner and customer with access to drivers for interviews. With the data we are collecting, we will also define, enhance, and measure path prediction performance over time. We will start with baseline data including intersection cameras. We will demonstrate the improvement with a re-trained model. Our goal for metrics is to demonstrate our ability to improve safety with pedestrian behavior signal accuracy from a baseline of X% to XX% over a 6-month span.

Sustainability Plan (500 characters)

Yes, Our goal is to continue improving our models to help improve pedestrian safety

4 comments

Join the conversation:

Comment
Photo of Mackenzie Fankell
Team

Hello Intvo LLC ! Thank you for sharing this proposal! I am a Michigan Central Station Challenge facilitator. I'm curious about the timeline for your technology to be adopted. Do you see this solution as having a high impact within the next year? Or is this solution designed to be more impactful as vehicle technology evolves? Also you know what percentage of the vehicles in the Detroit impact area will have the technology necessary to receive the broadcast pedestrian safety message in 2020? Thanks again for the post, and I look forward to hearing more about it!

Photo of Boratha Tan
Team

Hi Intvo LLC I work with Mackenzie as facilitator. I was also wondering how you would collect the data? Also, what concrete ways have you done to improve pedestrian safety (only via autonomous vehicles, using walking signals, etc.)? I seem to not truly understand how your software and research is translating tangibly to address the Opportunity Areas highlighted in our challenge. Thanks!

Photo of Intvo LLC
Team

Hi Mackenie,
We apologize for the delay, Intvo technology can be deployed in the impacted area by next year. Currently, we are working with PlanetM, City of Ann Arbor and UMTRI to deploy this technology in over 1500 vehicles by January 2020. This solution has a high impact in today's vehicles and infrastructure to prevent injuries and save lives without the need for fully autonomous vehicle. We expect over 25 precent of the vehicles in the impact area to be able to have this technology. In addition, we are partnered with fleet vehicles in the Detroit area where these vehicles will have this technology to increase pedestrian safety. Please don't hesitate to ask if you have any further questions.

Photo of Intvo LLC
Team

Hi Boratha,
We will use Intvo's vehicles and fleet vehicles to collect data in addition to the massive amount of data that has already been collected. Intvo software is designed to not only detect pedestrians but also to understand and predict their actions before they occur. These signals will be sent to alert the driver in order for the driver to be able to respond to the potential risk. This solution will have direct benefit on residents, workers, or visitors of the Michigan Central Station Impact Area by ensuring safety for vulnerable road users. If you need more clarification, please feel free to reach out to us at contact@intvo.com.