I would now like to turn the presentation over to today's call, Jocelyn Bauer. You may, Rhode. Good afternoon. Welcome to the web conference transportation performance measures so the public can understand. My name is Jocelyn Bauer and I will be giving a brief introduction before turning this over to Jerry Werner we are pleased to have as our moderator. Today's seminar is being recorded. Today's seminar will last 90 minutes and the final 30 minutes for audience question and answer. The operator will give you instructions how to ask questions. However, if during the presentations you think of a question, you can type it into the smaller text box underneath the chat area on the lower right side of your screen. Indicate who the direction the question is for. Please also make sure you send your question to all participants rather than just the host or speaker. Presenters will be unable to answer their questions during your presentations but Jerry will use some of the questions to start off the question and answer during the seminar. Finally I would like to remind you that this session is being recorded. A file containing the audio and visual portion will be posted within the next week. To access the seminar visit talking operations.webex.com and click on the recorded events link on the left side of the page and choose the session you'd like to review. Available for viewing listening purposes only and cannot be saved to your own computer. We encourage you to direct others in your office who may not have been able to attend to access the recording. The power point presentations will be available shortly. Attendees will be notified of the available and a transcript of this seminar. At this time I would like to introduce Jerry Werner, the moderator of the webcast. Jerry serves ads editor of newsletter and web master of the in talk talks website. He is consultant and communicator since 1991. In 1998 he was Director of. The predecessor website, the cooperative deploy.network. In that role he chronicled key strategic developments in the ITS and transportation management operations or MO arena. Prior to starting at ICBN he founded the popular website. Jerry consulted for leading organizations including ITS America and the University of Minnesota's institute. He holds a bachelor's degree in electrical engineering and retire to join the ITS field served as Director of Technology transfer for research consortium in Austin, Texas. Now I'll turn things over to Jerry Werner who will introduce our first speaker. Thanks very much, Jocelyn. Let get right to the presentations as we have a chalk full agenda today. The title of our webcast today is transportation performance measures that the understand. Our first presenter is Mr. Philip Tarnof, director for advanced technology at the University of Maryland and his talk as you can see is entitled customer focus performance measures. Phil's work includes preparation and delivery for training for the community, an active participant and leader number efforts on operations in such rolls as serving as a leader for the research agenda for operations and principle investigator for in talk sponsored measure of a short list of measures for performance evaluation. You'll hear much more about this shortly. Still also leads research in the areas of distance learning and transportation systems and provides support to the Maryland state highway transportation in the chart advanced traffic management system. Phil's been an active participant in maybe other projects including the wireless network for the Washington, D.C. region that enhances communication among first responders to emergencies. Retire to beginning his work with the university, president and founder of PB Paradahoumane. He was dealing with advanced technology too numerous to mention here. Phil worked at a division of a planning corporation in the federal highway corporation. Phil received his bachelor of science in engineering from Carnegie Melon University and a master of science in New York. He was given the prestigious Theodore M. Madison award. Phil, you can begin when you're ready. Thank you, Jerry. I'd like to wish everybody a good morning or afternoon as appropriate. I'd like to talk today a little bit in general terms about performance measures and what some of the issues are with performance measures and used with operations. And following that describe to you the work that we currently have underway trying to develop a standardized set of performance measures that can be applied nationally and provide both public and operators with a common language in which to compare their results and compare their activities. I'm going to begin by talking about the definition of performance measures and try to convince you why they're important with emphasis on customer focus. As I said talk about some of our ongoing activities including the measures that we currently have under consideration for selection. To begin with I'll read you this slide. Several aspects that are quite important. The definition is that they are the use of statistical evidence to determine progress toward specific organizational objectives. This includes evidence of actual fact such as measurement of surface and measurement of customer perception such as accomplished through customer satisfaction survey. You see we're talking about measures that are both quantifiable and those more qualitative which would be the customer satisfaction survey and talking about measures that are used internally by agencies for their own purposes as well as to communicate their performance to the public. Now one of the things that's important is no sense developing a measure for yourself for your own use unless you have defined also what is good. And this is true for both internal and external applications. We all talk about things such as signal timing. Signal timing in or region is terrible. Terrible compared to what? Compared to what the next community is doing, terrible compared to what is possible. This is an important aspect of coming up with a standardized set of numbers and that comparison will enable the public to evaluate their own agency's performance but also useful for agencies to determine how well they're doing to set standards for their own personnel but at the same time not all these measures can be quantified as I said so it's important to come up with measures qualitative as opposed to saying signal timing is terrible but at the same time meaningful. Now customer performance is very important. Received a lot of attention. As you can see this statement signed by President Clinton signed in 1993. They've been around for a while. He said the value of performance measures is to chart a course for every endeavor, see how well we are progressing, tell the public how we are doing and never stop improving the things we are investing in. The concept of performance measures that are useful to the public is essentially one in which the public agencies are reporting to their customers, the taxpayers and users of the transportation system. How effectively and intelligently they're using their money. I know we're talking about customer focus here but important to think about the agencies and how they use the performance measures internally. Agencies should be and many are beginning to use measures to evaluate their employees performance. Also using measures to interact with other stake holders which may not only be the public but could be other organizations with which they have to interface. The transportation field, the knee to communicate how their systems are performing to the agency next door or to the police or other agencies affected by what they're doing. And finally in order to establish goals for themselves so that they can decide the next year they'd like to improve performance in a particular area by a certain percent over what the performance that they achieved this year was, in order to do that, of course, again it's important to look at what other people have done, where they've had successes elsewhere in the country that can be imitated or copied so we can take advantage of the best practices of others. But it's important to realize that performance measures are not only used internally but externally so important to establish that balance when one is coming up with measures that everybody can understand and everybody can use. Now as far as our eye going activity, we currently have a project under way which is nearing completion that was initiated by an organization by ASTHO to develop is set of performance measures. It was picked up by the NTOC as I said the project is nearing completion. We expect to have a final report available in July. The goal, I'm repeating myself but the goal of the project has been to develop a common set of performance measures and we aimed for a list of about ten measures which has Tushed out to be quite a challenge. There are many, many measures used throughout the transportation community. Specifically addressing three types of situations. One is non-recurring congestion. That is congestion that occurs in unexpected ways. Recurring congestion. The most common example is morning and evening rush hours and system wide performance which are measures not associated with a roadway but effect a region. For example air pollution, fuel consumption, those things. And our challenge has been to get the transportation community to agree to a common set of measures they all feel are worth while and usable and measurable. We begin the work with a literature review which I'll describe to you in a minute and formed a steering committee of experts to work together to come up with an initial short list of measures. We met in Las Vegas with transportation engineers semi annual meeting and refined the list, made it shorter, worked on preliminary definitions and working with that final list developed in Las Vegas and trying to put more meat on the bones of the definitions which turns out to be quite a challenge. More difficult to define performance measures than one would expect and also talk about how they might be measured. Where they are political and where they aren't political. Quite an eye opener. We looked at more than 50 references and identified 50 measures asked by the transportation community for intentional and external applications. Some of these measures admittedly are variations on the same theme. A lot of ways of measures things such as speed, for example and each represents a different type of measure. This is the example that I just promised you. If one tries to define speed, it turns out there are a lot of different definitions of speed in common use. Average speed. How long did it take me to travel from point A to point B. Transit operating speeds, speeds on a freeway. I want to know my speed irregardless of how much time I spent on an ambulance or exit ramp, peak speeds and the two which are the biggest source of confusion. Space speed is a measure of the average speed in space from point A to point B which is what we're interested in. How long did it take me to get from point A to point B and timing speed. Timing speed is the speed that's collected by a vehicle detector that looks at a point and averages the speeds of all the vehicles passing that point. Space mean speed is more meaningful but time mean speed is more measurable. The issues we had to address when we are trying to come up with a single well defined measure. The third bullet on that current slide, some can be eliminated for example transit speed. We were going to focus on highway related measures. Not to say transit measures are not important. We decided we're not going to make progress at all if we don't start off with focus. Rightly or wrongly, focus on measures associated with highways recognizing that in the future it will be necessary to address transit measures as well. This is the beginning of the answer to the study. As I was telling you before, we developed an initial set of measures during that first committee meeting and this is the list. I'm sorry? I hear somebody talking to me. I'll continue on. The list was sorted into categories to ensure we had all the different situations I described before covered. I'm going to focus today's discussion in four general areas. They align closely it Phil's presentation but the first area I'll be talking about is how we measure the reduction of intents or crashes on roadways. second the importance of safety on our local streets. It's important to remember of the 43,000 approximate death that is occur on our roadways every year, 3/4 occur on local roads. One-fifth involve pedestrians so safety is important from that perspective. Talk about how we measure travel times and dray and touch on consumer satisfaction. Starting with reduction of incidents, this chart would be very meaningful to our customers, particularly or elected citizens. A high level measure but shows from 1987 on the left to 2004 on the bottom. That injury crashes have reduced from 4,224 all the way down to 2,354. Of significance is that rate column in the center where we had an injury rate of 4.8 per one thousand population -- that has continually been in the a downward direction to 3.5 per one thousand population in the 2004 year. Also we measured the fatal crashes as shown in the column second from the right. A little less meaningful and needs to be modified is the fatality crash rate per one thousand in decimals. It does not equate to a more meaningful measure to the general public. Because safety is so key, such a concern, too, to our citizens. Our mayor was quoted yesterday in our paper saying San Jose should aim at becoming the safest city for pedestrians especially for schoolchildren, seniors and the disabled. I'd like to touch on that just a little bit. Let's take a look at our pedestrian experience. This measurement is one that we provide with our city council every year and it touches our residents in that it occurs for people in your group and very much effects life and the quality of life so we strive to reduce our pedestrian and bicycle fatality because of the trauma that causes on a community. On the second column from the left you can see the total number of fatal crashes. The next column would show how many fatalities experiencing each year on our roadways. Then focus on pedestrian fatalities. This number for a city of our size is extremely low which I'll be sharing with you in a minute. On the second row from the bottom in 2003 was a year where we experienced an extremely low pedestrian fatality rate and we have been continually trying to lower this number all the way down to zero and that is our goal to add zero pedestrian fatalities on the roadways. In the early 1970s, approximately 30-40 pedestrian fatalities per year on our roadways. Going to the next slide, like to benchmark against other large cities. We requested pedestrian fatality information from 20 cities and responses from those shown. The rank by population is indicated in the second column from the left. Then the number of fatalities of pedestrians registered on the city's roadways shown on the right. Looking at the rate on the far right you can see how one city compares to the other. This is useful as professional engineer transportation planners work and strive to utilize solutions that are successful between agencies. Looking at local routes and travel delay is another area we measure and this is a meaningful way we share this information with our citizenry. Each year we have 20 routes deed -- defined local and five regional routes. We measure these routes all 25 of them every year during the peak hours of a.m., p.m. and off peak hours. What we can see interest a table like the one on your screen now is that for instance the first row Evergreen East which is a section of San Jose and the destination point to north San Jose in the a.m. period, the delay rate is about 2.606 minutes per mile. What that means is that for each mile of that trip, there's an additional two moneys per mile added to that trip during the a.m. peak period as compared to the off peak period. This is very meaningful as it allows us to compare travel times on corridors locally and regionally before and afternoon improvements are made on surrounding roadways. We also have developed a travel rate index and the travel rate index is shown here locally and regionally looking at the local one, this is an average of all of the 25 local roadways that we measure and the higher the indices, the more severe the congestion. For example an index of .25 would mean that a trip on a local roadway would take 20 minutes during an off peak would take 25 minutes during a peak period or 25 percent additional time factor. By averaging these 20 roadways you can show our citizens on local roads congestion is growing and freeway level due to enhancements our regional levels are decreasing. To give you an exam of meaningful measures so that we can focus on a reduction of incidents and maintaining better travel speeds in our city we have posted 31 dynamic signs that display drivers speed in school zones. These school signs are automatic, they are off during the night. They come on during school hour. They register 25 miles an hour until a vehicle occurs and then show the driver's speed. As you can see we've installed 3 of them. When our council members ask were they a good investment, we indicate that 86 percent of our motorists finds it effective in slowing traffic and a 6 percent average reduction in speed when they are activated. That's a meaningful measure. Another example are pavement embedded flashing light systems. We have 13 light systems in crosswalks throughout -- crosswalks through San Jose. We asked was it a good investment? We found it very effective increasing awareness day and night and the measurements here show that during the before these devices were installed, only 10 percent of motorists yielded to pedestrians compared to 49 percent in the after the lights were installed. In the evening the measurement is more dramatic where 5 percent approximately of the motorists yielded to pedestrians at night and 76 percent afterwards. We have pedestrian activated crosswalk warning signs. What these is they look like a conventional WB5 sign which is a yellow sign with a symbol of a pedestrian. The sign lights up and blinks or a beacon attached to that sign lights up and bings. We've installed four of these and found during the we had a 53 percent yield rate of vehicles of motorists to pedestrians before they were installed and 83 percent after. In the evening the statistics are show very positive. We also measure customer satisfaction. We do that every two years by telephone to 1,000 citizens throughout the city of San Jose. We do follow-up phone calls after service requests are made. An example of a customer satisfaction measure we use is the percent of customers rating our services based upon timelessness and added safety. Out of about 2,000 responses in 2003-2004 we had a 79 percent satisfaction rate. In 2004-2005 our satisfaction level has dropped to 70 percent. That can be because we have seen a reduction in staff and increase in time to responses and also traffic volumes are taking an upturn on our roadways again and people are more concerned about those issues. We do communicate our performance regularly. We do have an annual transportation report and we post that online and we have it available on all our public libraries. The web link for that annual transportation report has shown under the first bullet. We make quarterly reports to our budget office and our elected officials on internal measurements and as well as external measurements so that our elected officials and budget office can determine the investment, the quality of the investment we are making. Finally we rely on Mr. Road Show. An editor in the San Jose mercury news and does a daily question and answer column about transportation, transit and traffic and we will often provide him with information that the citizens of San Jose and beyond ask and there is a link to Mr. Road Show. And then finally I wanted to give you my contact information if you had any more questions about how San Jose performs some of their measurements so that we can improve our citizens and residents knowledge of their transportation system. Thank you. Thanks very much. Jim. Thanks for sharing San Jose's performance certainly one of the leaders in leveraging the leaders. No doubt about it. For our audience I'd like to encourage you to post questions in the chat area. Be as specific as you can so if you're looking for specific information, appreciate it if you could expand on your question as much as we can. We'll get to the questions shortly. Now I'm pleased to say we have a two-part presentation from one of the leading DOTs. As you can see the title of this presentation is customer performance maintenance for operations for WSDOT. And the first part will be given by Sandra Pedigo-Marshall who is WSDOT's planning and measure manager. Sandra has worked for 11 years, she led the planning process to develop the first strategic plan and has written and participated number several planning first including Washington's highway soft strategic plan and the pedestrian safety plan. Sandra's work as a planner and budget manager helps her identify and develop new and innovative performance measures for operations. Though we think of measurement as a separate process, it's really a planning subprocess that should be integrated into other planning principles. Performance measures are meaningless unless they are linked to improve. She emphasizes that people listen when you talk budget. Sandra, you can begin when you're ready. Thank you, Jerry. I just want to tell you about our state before I get into our joint presentation. We have over 80,000-miles in Washington state and that's public roads and our state Department of Transportation is responsible for a little over 7,000 of those miles. Keep that in mind when I tell you that we carry 58.1, almost 60 percent of the traffic is carried on that little bit of 7,000-miles so that what we're dealing with. Keep that in mind when I go through my presentation. What I'm going to talk about today is I'm going to start off with issues we considered when we were developing our operational performance measures and talk about a few measures still talked about in the first presentation identified out of the final 11 measures then talk about some of our data collection measures we use and then squeak in there how measures are important for planning operations. My first slide, there we go, these are some of the things we considered when we were identifying our performance measures and I want to let you know our measures are used for achieving justice within our admission. Also our customer who used the measures, managers, supervisors, the public, the legislature and as you know Daniela will talk about accountability so she'll get into that. And something important to me is we needed to understand the administrative support to do those measurements. What tools we have in place. What type of tools we needed to have in place to gather the information and the training it took to do that. We also needed to make sure we knew our corporation functions and I'm in the maintenance and operations division so we've gone through a process to go through our maintenance and operations plan and obviously people know what they do. They can tell you everything they do but it was very important for us to write it down and get the information out there. Not everyone knows what operations means so we went through a process that put that on paper and in a plan. When we did that it was easier to go through and identify some measurements. We have measurements in traffic operations I want to point out to you. Like we measure ramp and incident spots and traveller information so these are the measures that came out of our planning process. I'm not going to talk about the extent of congestion measure but I'll point out we are going through our plan update. One of the big issues was measuring congestion. We use a really very simple way right now to measure congestion. We use the number of hours of delay in a day but interesting things came out when we were developing our graphs. We'll see if I can find my little pointer. I think this is it here. There it is. This graph was something we showed to our commission and I thought it was really neat. This is real data. If you're going north on I-405. This is on a week day in May 2001. Hey you are riding along in your vehicle at 60 miles an hour. Riding along. All of a sudden the roads start to get crowded and you're at 2,000 vehicles per lane. Something happens here. It's too crowded and you go below the curve and it becomes extremely congested. What we try to do in operations is keep the traffic flow above the curve and this is our objective here is keeping the traffic flow above the curve. Then start talking about some of the measure that is we use that came out of the NTOC identification of measures. I'm going to start off with the hardest one for us and that is determining the difference between recurring or non-recurring or incident day. We had a hard time distinguishing the difference between the two with our data so we partnered with the Washington state transportation center and they did a research project. They used our data to try to tell the difference between recurring and non-recurring congestion. Some of the thing that is came out of the study was very interesting. I want to point out something very interesting is they found that 10 percent of the non-recurring delay was due to special events and this is interesting to note because this is something we can actually do something about with planning and working with jurisdictions. They also found out that it's very difficult to look at this on a state wide basis. We need to look at it because of the methods we set up to measure and collect our data. Another thing that came out of the study was that we need to have a national debate on defining recurring and non-recurring congestion. This is something that came out of the study and I'm sure you'll be seeing more and more about this. You can also go to the web links at the bottom of page two. Now I'm going to get into measuring incident response. This is something we do fairly well here. We're very proud of it. This is one of the tools that we must measure and each of our responders when they go out to an incident, they sell out one of these forms for each incident and they do it online, they do it in a safe location. They respond to on average over 4 thus incidents per month state wide so this is significant and this is a lot of data that we use. When our responders distinguish out, they record every single one. One of the things we have to make sure they do on this next slide is they need to receive training. They need to train the people putting the data in for you to collect so you have consistency. This is extremely important, very important to us, we do a lot of data collection here and we want to make sure everything was correct. Another measure we use is speed and just about everyone uses this measure. I just wanted to show you one of the graphs on comparing speed from one year to the next. To look at situations and see how they changed. We can present this to the commission and look at choke points or bottlenecks. Also the speed report and I pulled this out of our most recent report. I like this one. This is the 100 miles an hour club and these are locations around the state we've identified vehicles going 100 miles an hour or more. This information is great because we distribute it to the Washington state patrol and the safety commission. It's a commission we have here for highway safety and private citizens and attempt request this kind of data. The last measurement I'm going to talk about today is person through put and vehicle through put. We use this to measure the effectiveness of our HOV lanes. Puts out a report every two years. They hire a bunch of students. The students stand out and count heads in vehicles. I'm not kidding you. They count all the heads. They don't count everyone in the transit vehicles or busses. They call the agencies and get the ridership numbers for those regions. We put those out every year and show the percent change. Then my final slide, I want to emphasize the fact that linking planning and operations is very important. We have very good data in operations and we can actually show how operations can help the system with or without new capacity and my bottom line is that we use our operational performance data to make management and policy positions to monitor the system and I want to make sure that everyone knows that this is very important information to use if you have the tools in place to actually look at your system. Now Daniela is going to talk about how we use this information to show accountability. Thanks very much, Sandra. Experiences identifying and using performance measures and especially system of the interesting ones you showed helped improve operations. Let me give a brief introduction for Daniela. Daniela is Director of. WSDOT assessment office, a position she held since 20. She's responsible for the agency strategic planning, performance measurement and functions. In this role leads a development of one of WSDOT performance initiatives, the so-called gray notebook. Mrs. Bremer joined WSDOT 12 years ago. Shea holds a B.A. degree with an emphasis in business and exit science and a degree in business administration. As a native European and you may detect a hint of her accent, she brings a unique set of skills to support the focus on performance measurement and accountability. Daniela, you can begin when you're ready. Good afternoon. I'll provide more overview. Sandra spoke to some of the detailed measurements and I'll show you how you apply the measurements. The context of the effort, for maybe states and jurisdictions, sometimes an incentive that kicks off more of an interest and more of an emphasis in performance communication and even so many of us have collected performance data on elements over years and potentially for a long period of time there seems to be a momentum when I speak to colleagues across the country and internationally that bring it is into more of the high profile environment of let's talk about performance in these areas and I'll speak to them and that's held up tremendously in moving the effort forward. We often are pointed to as a national leader and I hope I want to make sure we share that with other state that is do great work with Maryland and so many good people out there so I don't want that title so don't do that. First I know some of our regional councils, welcome and hello to the others out there. As I share this message, this is something we all jointly work on together and cannot stress that enough it is an important issue. We have about 7,000-miles and of those we have urban miles. You can imagine a lot of that happens in the urban areas. So the region is important for us which is one of the most congested areas in the country and a lot of emphasis so when I speak to these measurements I have to qualify focussed on the congested region of our state. Speaks to begin this journey of performance measurement communication back in 2001 or I should say 2000 when we had a huge crisis. We had a huge significant drop in funding. We lost construction funding due to crisis. Accountability, the Governor, the media was constantly on our case. We were in a difficult spot. This led to a leadership change of the agency. We brought the challenge to enhance accountability to DOD. Always had a good, seen a doing good work but difficult to communicate to our company, what we're doing and how our efforts impacted and benefits from the tax dollars. So we began the process with accountability and project dollar. It's about 80 pages long. And has significant effort on very detailed performance reporting for all aspects including operational activities. I mentioned the funding issue. That's important. Explain a little bit how important operational activities became for us. When you don't have money to build roads, have you to figure out you can't tell the public we can't do much. That's not public. We have to figure out how to provide service to improve traffic flow and some of the burdens especially and what we can do to better serve our customers out on the roadways so it was not an option for us. We moved toward operational activities really became a center and a focus for us to say what can we do to mitigate criminal efficiency. We were caught in this issue about telling our stories and we have not as I mentioned done well in telling that story. The story is what happened to our system. Many of us struggled with this how to explain planners and local and regional partners. What happened to the system collectively, how the system supports, how do we explain what service they can expect for the tax dollars. We have not done well until that point and struggling, learning from people who have done better than us to figure out how to tell the story and important not to take ownership of this. Which brings me to an example. We have focuses from TTY on the line. It's again taken away from us as an organization. We never provide a lot of information on system performance and in access of system performance, the public and the press takes what's available so when we have our annual TTI report results come out, we were just back and forth in the press about how horrible our conditions are and how little we are doing about it. A hot of states can relate to this. Again we did not have control of our messages. We tried to explain what was said for others and felt we had control over this. And these rankings are a good indicator for the picture but doesn't tell you what happens with the system. Not a good substitute for that so we felt we had to step into the void and do something about that. So motivation by telling our story. How to be measured these areas. Demonstrating the program, what do you get for the dollar. In the end it's all about getting more money, more funding and we've been struggling with this for a while. Two years ago we got a 5-cent gas tax increase which was significant for us which was a huge accomplishment. And as of last Sunday night we have another tax increase of 9.5 percent, the biggest increase ever in Washington state's history and now we have to deliver that, a burden to deliver the second tax increase finance couriers. Here's one thing we have done. May 2002, enough is enough. Measuring up system performance and explaining to the public what is happening in the system. We talked about what the customer wants. Travel times is what customers can understand. Level of service, engineering firm great internally but when you try to increase service, you get strange looks. Our performance measurements have to go to travel times. We have to measure realtime information so leverage our investments made over the last 20 years and use the data but we have not used it. We also side we need a measure which Sandra talked about. And we still have lots of ways to go in better understanding how to measure and differentiate between re-occurring congestion. Doing has a criteria, a condition to better understand improvement. There were some questions about how do you measure impact of operation improvement. That's the point, you have to figure out how to distinguish between congestion and that's still a mag work item for us. We made strides. And communication. We have to explain to the public interprets we can understand what's happening with the system so we all, engineers have it take language training saying what package is necessary to communicate to the public and not what we call Washington state performance journalism. I'm going to show how we communicated. Sandra talked about some of the details how we measure that. I'm going to show examples on the operational sued first. One thing we have done when we had revenue degrees, inventory was repealed. Operational improvements. We are trying to find out how do we justify finding in light of the conditions and working with the legislature. We received funding to increase these initiatives. Doubled our program as a result. Sort of the chicken and egg issue. Where do you start and get the money for it. You have to start somewhere. And duct taped and wired performance measurement together in the beginning to show performance and get funding and now much more able to do better in communicating this. We still struggle with quantifying improvement in terms of economic value. Measurements were bolder in quantifying improvements and better at doing that. That's an area that needs to be better explored and better communicated. And we cannot, when you have a national effort, a consistent way quantifying what the improvement means in dollars and so forth. We have done aggressive effort getting their opinion and input when we increase our services or provide services, once you provide services, you have opportunity to use the information to get from the public to justify what you have done. Here's an example what is relevance of public, having the folks help on the roadway. It's very important to a citizen and almost impossible to get feedback. In general people happy to get a service and we use this information to see what public citizens have said about the service. It's a qualitative measurement. Ramp metering, a lot of before and after. Before and after analysis is the issue. We definitely have to do much more than that. If you put a project on the road or implement an operational activity, you have to understand your before conditions and measure after conditions. We tell them how it relates to the troubled times and the ability to move from one point to the other. We show the impact on 520 and using precharge to show the different activities over time and improvements are significant. Stop and go traffic has reduced to a small point. You have to law with the notion, how technical can it be. Initially had concerns about the charts because you saw it might have been too technical but surprisingly well received. People have an easy way to understand it and surprised us so we continue to see those. The number 2000 is correct. Probably more than that. Quick question. Here is another example how this can quantify and show results, a lot of graphs and very specific. A strong control how we do graphs. We make sure our communication is always that everybody includes plant engineers use the same method. Graphs have to be simplified. We put it into another software and MIP NDN-21Z -- so we take our data and make it more meaningful. Here's another study. What's relevant to the study and tell them what it means to them. Don't be afraid of the technical aspect because it's probably very astute in some of these issues. I will talk about examples in the areas. More general to the transportation system in that area so show examples of that measurement here. As I mentioned in 2002, we moved to measuring congestion in terms of travel time. Or we could measure it. We have the archived data. Obviously we are dependent on that and other ways so better ways to measure this. For us we rely heavily on our data. What we have done is collected data tore many, many years and rate people working on this for many years and momentum that comes on board and says we will communicate our travel time. Within the short time period Sandra worked on this and much of our planning offices and our office within four months put our dual travel times which are updated every five minutes and the commuter can go to the website and pick one of the 24 corridors to see what the current time would be and that's a very powerful tool and huge, so much response to media. It's a powerful tool. Very well received. Loop data, we travelled routes with students we measured at the times. We did some checking, a loop of faith here and we hope that it wouldn't crash on us. It didn't. Sometimes you have to take rustics because you might spend another five years calibrating your data. Meantime you're losing credibility so you have to decide when data is ged enough and the quality control is important. You have to keep at it every moment. Data is highly scrutinized and we can extract the data. The data on the right side, it's showing another tool using what's important to public reliability consistency and here is an example of the liability measure that shows you central liability, how much time it takes to get to your destination. This is a tool we've been using for a year and a half now. Has in the got such a strong response as the other tool, something we're working on and refining. Showing travel time for all the quarters. Using it as a performance measure before and after comparing year to year showing travel times before and after. Ninety-five percent reliability using it as performance measurements so not just for public use, for internal measurement purposes. Another use very well received was something kicked off in February. Moving into this area of more information sharing on our very powerful and popular tool. Make sure these times are correct. Quality control of the data. Here's an example that shows capacity to shows potential to improve traffic control. This is a very important tool. It's a graph used in public legislature and very well received. I saw the client's name on the list of attendees. A great performance report and this is a Caltrans' idea we embellished and used the work in that. The difference between capacity and through put what we can do through efficiency improvements on this route. Communication tool and argument for improvement. I need to wrap up. Leave it to you to look at the examples. After analysis is a critical tool. Using it heavily. We need to do much more of this but very well received. The next step for us, again our leader has given us a challenge about eight months ago. Find out what works and make it work now. Don't wait for technology to be implemented elsewhere. That goes better to the point of finding better data and measurement opportunity both for capacity improvements and operational improvements and we have to work with our partners together to make that happen as a DOT or local jurisdiction cannot do it alone. A big job we have to do together so thank you for your time. The presentation, our website, some of the papers we wrote, our information and data linked to this and you can use this to spend more time if you have more interest. Okay. Thanks very much, Daniela. Interesting stuff and we will have your power point and all the power point presentations online. Hopefully online by tomorrow morning and encourage people to go there and see the detail on these presentations. We've had a lot of great presentations and we have a good questions so let's get right to them. This is an observation but turn it into a question. Design to meet requirements, kind of an interesting question, how do you do that? Start with Phil and open it up to anybody. Any thoughts on that, Phil? Jerry, can you hear me? I think there's a lot of issues associated with this. That's a question, particularly one to start with. First of all it's important and several have mentioned to decide what measures you want and where you want to collect them. I'm assuming how to automatically collect the data as far as detectors or cameras. There's some measures that just are not compatible with automated collection. I think it was Sandra mentioned the process of collecting America through put. I think measures such as speed can be collected and signs can be put in place to put collectors at locations where there is flow where that even if you're collecting a speed at a point, that point is representative of what's happening on the street. A example is a single arterial. You couldn't put the detectors near the intersection but where traffic was flowing at a speed that could be measured reliably. Let me ask another and this is a general. I had to think about it for a bit. This was a question between two of our audience members. One of the parts of it was how do you compare sensor data you're collecting from the measures. That begs a question do sometimes you create measures because you happen to have the data and is that the measure you want? Let me open that up to any of panelists. I'll jump right in. Speed again is the paper example where we use speed. So there are many times you do that. Too expensive to measure things reliably and in real time as well. On the arterial level, using sensors to measure delay at our intersections and we have advanced sensors sometimes 250 feet in where we do focus on average speeds over those points. In Washington State on our arteries, we have a difficult time getting realtime data because we don't have the infrastructure set up. We have floating car surveys but on our freeways we have extensive especially in the Puget Sound region, very extensive system set up that collects data in our loops and we use that, we set it up originally for ramp meters and then we transferred it over to information on our website and that's how we sided to get the information for realtime travel time so we that information out of the loops for our realtime travel times. Interesting. Let me jump to another question here. One of our audience members says he has a strong interest understanding the cost on commercial vehicle movements and measuring the impact of different initiatives on reducing the commercial vehicle impact. Does any of our panelists know measures that might get it commercial vehicle area? Doing tax rate, a and study using tax to measure travel times at this point. Something that's high importance but lacking a lot of data and that's definitely a challenge for us. We've done a sample, too. We have our vision extensive through our state. The commercial vehicle information network and that's not the transponders that can pass the way station. We've had volunteers we use to document where different vehicles are during the length of a corridor and we've been able to measure delay through that and do a cost analysis on that but it's been a small project until we get some of the things started up. Just one other point. When you talk about commercial vehicles, the term is troubling to me because there's no one commercial vehicle. When you say commercial vehicles, the image pops up into your mind a tractor trailer on an interstate. There's a tremendous number of delivery services, taxis, people in vans that are plumbers and roofers and things like that that are commercial vehicles, also. What is the cost to commercial vehicles is a little bit, you need to be much more specific. One of our audience members observed that one of the slides stated that organizational objectives must be first to find for performance measurement and wondering what are the national objectives for highway performance. Phil, you might be a good one to get a start on that. That was my slide. There was no intent on coming up with national performance measures that we're going to have a national measure for how much delay is acceptable at a traffic signal. The idea of setting up objectives was to address things some of the other speakers mentioned and Jim talked about safety. Safety performance and other cities. The thing I wanted to do was look at cities comparable and situations comparable to yours and use that as to how much better I can do. I didn't mean to imply coming up with benchmarks people should be using. Let me -- Jennifer to you. We had questions related to your comments about safety. One person says congratulations for reducing the accident rate but how do you monitor that safety programs don't discourage walking? I was glad to see it. A couple of things are important to consider. San Jose, we have a fair climate. We have a very, very good year round climate which does include walking and good geographical terrain so in both regards we're a community that focuses on walking year round. Some of the ways we were monitoring those to make sure we're not crossing pedestrian travel while we're reducing accidents is we've written into our general plan a pedestrian element. We have focussed on pedestrian corridors, design and strong emphasis in land use connection to trails, bike ways and pedestrian systems. We have a goal for health in our community at a county wide level. We've worked crossly with our officials to encourage walking. We set individual goals on roadways so we have a higher goal for more pedestrian travel on certain types of roadways such as near our schools or our downtown areas. We've changed our design standards so all of our sidewalks and ramps are pedestrian friendly. Ramps means ramps on the corners for the disabled community and standards we've changed so that street trees are now on the outside edge of the sidewalk to buffer the pedestrian between the able where as before they were on the inside edge of the sidewalk. Comprehensive planning and I'll finish on this one, we are writing our level of service policy and we talked about level of service being a technical measure. We are going to have a new policy on several roadways in our city that if we wish to encourage a higher density development in a transit corridor we will allow that to go forward and go beyond the motorists level of service. But the mitigations that the developer will be responsible for is for other modes of travel particularly transit improvements and pedestrian improvements within a specific zone of that development. So we are actually indicating that in some corridors we will allow degradation of motorist flow for pedestrian flow and those are examples. We had a question, I'll open up to all the panelists. How do you measure customer satisfaction. We are familiar with quantitative measures of effectiveness. Our agency relatives here have quite a bit of experience in that. Any stabs at it? In San Jose we do receive about 3,000 calls per year for service and we will randomly call back customers that have left contact information to request from them the quality of that service in regards to satisfaction, solution, quality of the interaction with the employee handling the complaint and also the timelessness and then I mentioned in my presentation that we do phone surveys to the population at large. I might add that we do educational seminars in our neighborhoods and it's regarding traffic calming generally and we refer to that program as our street smarts program. We set up academies in neighborhoods and we measure customers response to those academies whale we're onsite working with the community. Let me forward that to the Washington state folks. Sandra and Daniela. Do you not do a lot of surveys based on the outlook, for example? We're doing surveys, I have to say we are in the high on these broad-based customer surveys. We survey everybody and everything every five minutes and people were saying no more surveys, please. We have done a specific survey in particularly regions and areas state wide,ed before qualitative service giving input. We have one survey last year with commuters in the Puget Sound region, we looked at issues and feelings about the system what's the most correct issues were and we got input between people's driving behavior was more than an issue than bottlenecks. Good indication that efforts in our safety programs have to be just as stepped up as our efforts. Equally we looked at funding issues. What's your priority. If you had money how would you want to spend it. Thirty-three percent of us spend it on maintenance, transit and bottleneck so equal distribution feedback from your customer on what their priorities are and equally high. What do you do with the information. You have it use caution how it's administered and distributed and you have to take great caution how it is played so spending a lot of time thinking about the issues but no annual mass survey of sorts. And one of our other challenges we were talking about is we do regional surveys. Our state is so unique. We have such a diverse population here is that the east side and west side of the state and so many things on the east side than the west side and so difficult to do a statewide survey. We do have a comment card that our instant responders hand out after they provide a service and we think these are always going to come back positive. If somebody helps you, of course you're going to say, yeah, great. And we document those and we use those to not only talk about the program but now our responders until we send them back to them and they get to see a job well done but we have received a couple of negative cards back but rarely so that's not a good customer service. Thank you. We have a hot of questions to get through here. Let me jump to a different one here. Have any of you looked at the possibility of traffic engineering measures, that is highway capacity measures with those the public can understand better like travel time and as the latter standards to evaluate operations as opposed to something like level of service. I was surprised I saw that question. That was one of the points I was trying to make is that we are sensitive to travel time reliability as customer related measures right up at the top of the customer's list. Certainly in terms of national activity receiving a lot of emphasis. We concur with that, too. We would, too, in San Jose. As I indicated we do use the more technical formulas often when working with our developers but for our master planning and working on plans for regions we with focus on travel time in the corridors. So the conclusion is that it is changing. Sounds like it's changing rapidly, too. Just an observation, several people talking about transit measures and there was one person suggested that the PCRB6 project has a lot of god information. I don't have the website handy but if you go into Google and type in PCRP you should pull that up and get in the right neighborhood there. We had a number of questions about performance measures related to ramp meter deployments, has anybody worked on measurements for large ramp meter deployments and the related question is feeder arterials. Some of the work done a few years ago in Minnesota where they turned off the ramp merges for a couple of weeks is a resource of information. Is anybody else working in that area? We're almost fully ramped in Santa Clara county. Actually I did Mack reference to Gary Richards in the road show. He has often set up actual tests of working with Caltrans turning ramp meters off and comparing travel times on or off and publishing the results in the newspaper and turning a lot of heads, I might say turning nonbelievers into believers. Particularly if you look at the overall travel time including the delay on arterials. I know Alameda county to our north has done comprehensive studies with local consultants and I Know we have worked with Caltrans at quarterly meetings that our engineers and planners hold together to look at impacts on our arterials. And I might add our great folks up in our northwest region, that's where the majority of our ramp meters are located. They do a hot of studies up in that region and if you go to our website, just put in ramp meters in the search engine there it will bring up studies and information they've done in that region. Quickly, Washington State DOT, we had a question, how well is Washington performing in regards to your current objective? We'll talk about that. We've been doing better lately. The 90 minute measure was set with our partners, the Washington state patrol and emergency responders and as Daniela said, we have a joint operating policy signed by our secretary of transportation and our Washington state patrol chief. We're doing better, what I mean so say is it's a lot about training and not only training our responders but training patrol and training emergency management people that out there on the roads it's in the, important to be safe, that's number one priority, safety. But we also want to stress that we need to get the incidents off the road as quickly as possible to get the traffic moving, free flowing. We're starting to plateau over 90-minute incidents. We measured on a state wide basis. We can go down to specific areas on a call out basis. That's going to be involved. We are plateau out at about a little over 150 minutes. Like I said, we're still working on that, putting a lot of emphasis on that lately. Would agree with me is the benefit of the target is more in the understanding of the urgency and issues understanding a level of safety and moving trucks from the highway system and more important and more benefit which is probably the idea behind the target. Can I say one thing, Sandra mentioned fatalities. One of the things they've done in Maryland in analyzing the clearance time they discovered that a lot of the delay was associated in getting the coroner to the scene. You can't move an incident until the coroner arrives and does his thing and they've had tremendous success in providing training to the state police and providing statute plus on the scene so they don't necessarily have it wait for the coroner so creative things like that down to the next level or up to the next level. We had a question, what have most jurisdictions done to aggregate data at the gain level to get a congestion performance measure. Kind of an interesting, are you doing that aggregate data? The whole entire area? Maybe I misunderstood the question. I guess it's kind of a question individual agencies get travel time data dorks they do any work to combine it. In California in the San Jose and observation, San Francisco metropolitan areas here, our metropolitan Mr. Clinton organization spans nine counties and 106 cities and we do work with our partners at the PPO to look at final congestion problems and I did indicate at the local street level we are measuring 20 corridors a year at the local level and then we will throw all of those into one factor and try to demonstrate what our congestion level looks like on that 20 with one index. Let me do a couple more and then we will wrap up here. We had a question, has anyone conducted an evaluation of highway advisory radio on streets relative to traffic flow and what measures might be used for that. At the local level I can say in all we have sensitive tv in our downtown core, approximately 20 cameras on tall 45-foot poles near intersections. While we have not really developed a specific measure for the effectiveness of the cameras, there's two tricks we've learned. You have it have an operator viewing the image and that operator can determine the effectiveness of the system through the use of that camera. We have over 200 special events each year and many occur in the downtown arena which seats 9,000 people. We have a goal to clear the arena and the local streets within 20 minutes after the event is over to clear all congestion within 20 minutes time and we do utilize cameras to measure the effectiveness of that goal. We did have our audience member added an additional detail to regional measures. At the regional level across the region or broader, is total hours of delay a good measure at the regional level. Sandra and Daniela, that's back to your issue something at the MPO level see if it makes sense to have a regional level of that type. I know the MPO has been calling us to get travel time data so I know they are starting to look at that. Let me finish with this question. To what extent -- and open it up to Jim or any panelist, to compile and disseminate performance measures. A lot of what we're here about is what they are doing with their own detectors and is on. Are you talking and using the private sector in this effort? I cannot off the top of my head think of situations except when there are special events. For instance those 20 corridors each year we monitor, we bring the private sector in to assist the staff so we can have a comprehensive collection of data so we do hire a private sector in that regard. I have to think of other examples. Conducting an experiment with major trucking companies to report their travel time of speeds on interstates and cooperating willingly. And that's the study we're starting up to and working with. There's a related question we haven't gotten to using GPS or other technology to collect travel time data. You are saying that's on the horizon. It is on the horizon. Great. Thanks very much for all the participation. Let me wrap up this webcast with more information on the NARNL Transportation Coalition. Here you see the organizations of NTOC. A little data now. We encourage you to go to www.NTOC.com and find out more about the organizations. Information about upcoming webcasts. It will link you right to the talking operations registration site as well. Also an archived page with a lot of information power point slides, transcripts and so on of past webcasts. We will have the slides from today's presentation which will be interesting to all presenters hopefully by tomorrow morning. Let me mention briefly that our webcast lineup is has shaken a little bit. The next one is on May 25th, on the vehicle infrastructure initiative VII. Sign up as soon as you can on that. Every one of our webcasts has been oversubscribed so far. Again back to the slide on the website we have two discussion forums talking operations as well as ITs techno-forum and posting a couple of key interesting questions on this webcast in the next day or two and now you to continue to dialogue on those issues. The North Carolina website included link -- the NTOC website includes links and you can sign up here to receive the newsletter, the free newsletter by e-mail twice monthly. So that concludes our webcast today. I appreciate all of our presenters, very interesting information. Appreciate all the questions and participation by our audience and wish everyone a great rest of the day. Ladies and gentlemen, we thank you for your participation in today's conference. You may now disconnect -- good day. (end)