Real-time Traffic Data is Available From Multiple Sources
A decade ago, it was hard to access timely, accurate traffic data to support applications and services, such as traffic management, mapping and navigation, safety and emergency management, urban planning for smart cities, or location intelligence.
Today, real-time traffic data is much more widely available as public datasets and commercial sources. At the same time, there are many more new applications and machine learning algorithms that use real-time traffic data to reduce congestion, guide drivers, and generate new insights for decision makers.
In this blog post, I’ll discuss how real-time traffic data is collected and describe the pros and cons of the most common sources.
Many municipalities have deployed closed-circuit television (CCTV) systems for surveillance purposes. These can be used for measuring traffic.
- Ongoing Cost: For municipalities that have already deployed video analytics systems, there is no extra data collection effort.
- Coverage: 24/7/365 coverage
- Cost: This option utilizes a low number of very expensive sensors. Municipalities must maintain camera networks, and analysis of the data can be labor-intensive.
- Consent: Drivers and passengers have not provided direct consent to being recorded. License plate data is captured by these solutions and may be considered personal information. Driver and passenger faces might also be captured. Today, redaction of this personal information is time- and labor-intensive.
- Limited Access: It’s illegal for municipalities to give access to data without consent unless costly de-identification techniques are applied. These techniques typically reduce the usability of the data.
- Limited Coverage: Information is only available where cameras have been placed.
- Accuracy: Cameras may lose accuracy in heavy storms or other extreme conditions.
- Limited Data Richness: It’s difficult to get any information beyond speed and location.
In-Roadway Traffic Flow Sensors
There are several types of in-roadway sensors that can be placed on roadways or within the pavement. They are another useful traffic data source.
- Ongoing Cost: For municipalities that have already invested in sensors, this is an existing data source upon which they can capitalize.
- Few Privacy Concerns: Sensors can detect vehicles passing over them but do not collect any information about those vehicles.
- Coverage: 24/7/365
- Cost: Sensors are expensive to place within roads and maintain over time.
- Limited Access: It may be difficult for private companies to access data owned by municipalities.
- Limited Coverage: Information is only available in locations where sensors have been placed.
- Limited Data Richness: It’s difficult to get any information beyond speed, location, and possibly weight. In addition, sensors can’t recognize the same vehicle across multiple sensors, so they don’t support continuous analysis of trips, which add a deeper understanding of traffic anomalies and also help identify errors in the data.
The RFID transponder devices that consumers place in their cars have the ability to transmit data that includes a unique identifier (the toll card number) and location (captured by an RFID reader).
- Low-Cost Solution: In geographic areas with bridges and toll roads, many consumers place these devices in their cars.
- Consumer Consent: It’s practical to require that consumers consent to data collection during the device registration process.
- Privacy Concerns: Even if consent is in the fine print, consumers do not expect that they’re being tracked when they’re not on toll roads. In the U.S., the American Civil Liberties Union (ACLU) has raised concerns about this data collection practice in New York State.
- Dispersed Datasets with Limited Geographic Coverage: In the United States in particular, toll authorities are decentralized state or local agencies with limited geographic reach. Other countries such as the United Kingdom also operate toll authorities at a local level.
Mobile Phone Data (Floating Cellular Data)
Data from mobile phones with location tracking switched on can be used in aggregate as a traffic probe. This data is also known as floating cellular data.
- Low-Cost or No-Cost Solution: Public datasets are available.
- No Practical Limits on Geographic Reach: While other datasets may be limited to specific geographic areas, phones go everywhere.
- “Noise” in Data: It can be difficult to distinguish between people walking, cycling, driving, or riding trains, so floating cellular data requires complex algorithms to generate adequate data quality.
- Privacy Concerns: Privacy advocates and media organizations, including the New York Times, are raising concerns about the consent processes that have allowed thousands of mobile apps to collect location data. Tech companies have responded. For example, starting with Android 10, the Android operating system now requires apps to obtain explicit user permission to collect location information when the app is not in use. Apple iOS 13 provides users with a map view of how apps have been using their location data in the background. As consumers become more aware of how their data is being used, fewer may consent to the levels of data collection that have been occurring in the past.
Connected Car Data
As more vehicles become connected via built-in telematics and onboard devices, connected cars have become a very useful and direct source of traffic data. Any other data sources are making some assumptions about how vehicles are behaving. Data can be collected directly from the vehicle’s electronic control units (ECUs) or Controller Access Networks (CANs). With solutions like the Otonomo Platform, it’s quite straightforward to access.
- Low Cost: Essentially, each connected car is operating as a low-cost sensor, with no incremental installation or maintenance costs.
- Data Richness: Connected car data offers more predictive value with richer data points beyond speed and location. These may include braking, air bag deployment, ambient temperature, windshield wiper operation, and more. Connected cars can also provide visibility into environmental events (e.g., road signs). Therefore, connected car data provides a more complete view of a geographic area and can support more complex use cases.
- Data Privacy and De-identification: To enable data privacy safeguards, data passing through an OEM’s data centers can be stripped of identifiable information, such as the VIN. Location information, and other personally identifiable, so data must be aggregated as well. For example, Otonomo reduces the risk of exposing PII with the Dynamic Blurring Engine.
- Consumer Consent: OEMs have the opportunity to educate buyers and obtain consent for data collection during the vehicle purchase process. Many commercial fleets already obtain employee consent for vehicle tracking and behavior monitoring.
- Data Availability: Today, not every car is connected, and much of the data is not yet available. Select OEMs and fleets have partnered with companies like Otonomo to find ways to utilize connected car data and put business models in place to support these use cases. We expect this data source to grow significantly in 2020 and beyond.
- Data Heterogeneity: There is no single standard format for car data. Depending on how you are accessing car data, you may have a hefty amount of work to do around data cleansing and normalization. (This is a significant value-add provided by the Otonomo Platform.)
- Privacy Concerns: As with other data sources, consumers may not be paying attention to the policies through which OEMs are collecting connected car data.
Every Application May Have a Best Traffic Data Source
Both historical and real-time traffic data have many potential uses that provide tangible benefits to individuals, municipalities, and the public as a whole. There are upsides and downsides to every potential data source, so it’s important that you do your homework if you’re planning to use traffic data for your application.
Want to Learn More About Evaluating Historical or Real-Time Traffic Data?
Click here for the questions you should ask of any traffic data provider you’re evaluating, covering both data characteristics and data APIs.
Be sure to download our traffic data datasheet, if you are interested in seeing how connected car data can do for you.
Want to Test Drive Otonomo’s Connected Car Data?
Click here for a 30-day free trial.