video real-time analytics
of data held in Microsoft SQL Server-based warehouse
faster batch processing
Upgrade the city-wide surveillance camera infrastructure and implement an on-premises big data analytics platform to provide fast, real-time data to stakeholders and transform business operations.
Making the roads safe necessitates pinpointing hot spots and trends, mitigating and reacting swiftly to issues, and monitoring the performance of the entire transportation network. In addition, multiple stakeholders and partners – from police and emergency responders to third-party application developers – need actionable insight on travel activities.
Roger Jones – CHIEF TECHNOLOGY OFFICER
Auckland Transport
The agency faced the challenges of launching a new CCTV system, converging the units and their data, and then assimilating and churning out vast data volumes to those who need to know.
Auckland Transport was formed in 2010, when the transport functions of the eight former Auckland local authorities and the Auckland Regional Transport Authority were combined, to oversee roads, traffic networks, and public transportation. The merger yielded five different operational centers with various technologies. A small staff monitored hundreds of older CCTV screens and tracked inputs on pedestrians, cyclists, and vehicles.
Three years ago, the agency selected video recording and analytics powered by Micro Focus IDOL, a data analytics solution that enables personnel to derive insights and patterns from massive amounts of real-time streaming video data. Housed in the agency’s facilities, HPE ProLiant BladeSystem, HPE 3PAR StoreServ Storage, and Micro Focus Critical Watch support the IDOL platform.
This year, with a major new refocusing on public safety, the agency is enjoying the benefits of their investments. They have built a dedicated in-house team of video analytics specialists who work full time with Micro Focus IDOL’s Media Server application, the highly configurable computer vision engine. This team combines analytics including Scene Analysis, Automatic Number Plate Recognition and Object Classification to build and run scores of user-story-driven analytics scenarios for surveillance and to gather evidence and accurate statistics about pedestrian safety and traffic flow all across the largest city of the country.
The agency extracts about 1TB of data monthly from the train CCTVs and at least 8PBs of data weekly from street cameras mounted at intersections. In addition, the Microsoft SQL Server-based warehouse holds around 3TBs of data. The IDOL data analytics platform processes CCTV video analytics, integrating that data into the incident management system and feeding the Vertica analytics database to enable data mining and higher-level alerts based on the combination of multiple video analytics events.
Over 500 video analytics are currently running on over 200 cameras in real time with an additional 200 plus having been used in the past for completed projects. All these analytics results enable staff to respond to issues that make 1.4 million citizens safer on the road. Agency personnel can detect traffic violations, congestion, and parking problems, as well as harness patterns uncovered by the IDOL platform.
Multiple stakeholders inside and outside the agency benefit from ad-hoc investigations built with video analytics at their foundation. Whether monitoring pedestrian safety at an inner-city railway crossing, quantifying the problem of vehicles running red lights at a major intersection, detecting vehicles illegally stopping in bicycle lanes or measuring vehicle speed at key points of interest, Micro Focus IDOL video analytics is enabling the agency to build a richer picture of how the Auckland transport network is really used, enabling the agency to improve safety in all areas of transportation in the city. “The public safety is a huge step increase,” Jones admits.
Roger Jones – CHIEF TECHNOLOGY OFFICER
Auckland Transport
Putting the data to work, the agency has gained an integrated ticketing system with insight on travel times, patterns, trip frequencies, and demographics.
“We can now start to tailor our messaging, especially for transport, to the stops where people are at the right time of day,” Jones says. Instead of conducting ad-hoc surveys, city planners can use the real-time data from license plates to construct heavy transport and trucking options.
“This is very much about the planners having reliable information,” Jones says.
Current statistics and other significant volumes of data – such as the parking system – reside on the Vertica Analytics Platform, which processes structured data quickly. IDOL feeds this growing repository of relevant knowledge by producing live alerts from long-running video analytics like pedestrian counting and anonymized Automatic number Plate Recognition across the agency’s CCTV network and accelerates the delivery of insights from it, linking statistics with historic corporate information and financials in the SQL warehouse.
The warehouse data integrates with the Vertica and API Management Solution data stores to provide integrated reports at the front end. The data analytics platform provides faster end-to-end batch file processing. Previously, batch processing took 4.5+ hours. As a result, service, bus, and ferry operators could not leverage needed information when starting their workday. Now, batch processing finishes in 2 hours.
“We have a huge performance increase,” Jones explains. “When the operators come in to work, they have yesterday’s information, and they can make the right business decisions. The API Management Solution platform can manage streaming of high data volumes at high velocities.”
Using Micro Focus IDOL, AT can now remotely enforce traffic rules on special vehicle lanes with video analytics. This reduces operational costs and increases compliance with bus lane regulations.
The agency’s latest success is the well-publicized deployment of a special vehicle lane use enforcement system based on analytics, which, for the first time, provides a practical and automated mechanism to identify and generate evidence to fine vehicle owners for illegally using special vehicle lanes such as bus lanes. By providing a real deterrent to back up the ruling set by the New Zealand Transport Agency, AT will promote safer and more efficient road use for all commuters in the city of Auckland.
Through its investment in big data technologies from Micro Focus, Auckland Transport is building upon its “Future Cities” vision, one in which developers and officials employ all types of data, sensors, and technologies to improve products and services for their citizenry. Jones sees the agency continuing to enhance resident experiences as more agency stakeholders and partners fully grasp the potential of big data.
“We are looking to enable them to take that data and do something with it, find patterns we don’t have the expertise to find, and deliver value back to us and to everyone else. We’ve provided the platform and enabler. They must pick it up and run with it,” he concludes.
