Now with heat maps!

turbofish

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Nov 2, 2018
Messages
301
Reaction score
620
Location
NW Arkansas
I finally found a Power BI map that will allow me to share with the rest of the world.
Here is a static image that you can see all of the reported wa-e events that are located within 75 miles of my zip code over the course of the past 3 months:
72756.jpg


And if you want to play with this map, click here where you can zoom into a particular area.
If you want a map for your location, just give me your zip code or a zip code that you want a 75 mile radius of.
 

firstsage

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Apr 15, 2016
Messages
180
Reaction score
98
I finally found a Power BI map that will allow me to share with the rest of the world.
Here is a static image that you can see all of the reported wa-e events that are located within 75 miles of my zip code over the course of the past 3 months:
And if you want to play with this map, click here where you can zoom into a particular area.
If you want a map for your location, just give me your zip code or a zip code that you want a 75 mile radius of.
This is really cool!

Is this all events, or specific events or all reports?
I'll PM you with my zip.
 

dchemist

Advanced User
Lifetime Premium Member
Joined
Jul 26, 2017
Messages
3,251
Reaction score
6,084
Age
41
Location
Benton, AR
What can you do with 72019?
 

turbofish

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Nov 2, 2018
Messages
301
Reaction score
620
Location
NW Arkansas
specific events, namely police spotted.
I have noticed that it does take a minute or so for the web version to load and some locations like Dallas, I will have to decrease the radius since it will return 250K of rows which will really slow down the map. It takes me just under 2 minutes to run the query regardless of how big the radius is- nothing to really optimize since I'm only going through 3 columns. I did find it a bit unusual that it takes my fairly powerful laptop [7 gen i7 with 32 GB of ram] the same amount of time as it does my more powerful desktop [AMD 1700X with 64 GB of ram]. That can only mean one thing - time to upgrade [any excuse will due]. It is the spatial data that takes a while to run through all 15 million rows of data. I'll start making some new maps when I get home. Wifey has a dinner that I'm not required to attend which means it will be cigar night with the laptop on the back porch. Shame that the heat index where I am is around 107 degrees
Post automatically merged:
What can you do with 72019?
Zip Code 72019
 
Last edited:

dyn0mitemat

Advanced User
Premium Member
Joined
Dec 4, 2015
Messages
891
Reaction score
905
Location
NE, Ohio
This is very interesting, thank you for putting this together.

I wonder if these results can all be drawn up like you have for the whole US, and then with some filtering and what not, if something to the effect of Trapster can be made out of this info. Possibly could be used for into and added into the rdfgps or whatever the next name was going to be
 

turbofish

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Nov 2, 2018
Messages
301
Reaction score
620
Location
NW Arkansas
The big problem with that is generating the maps which tends to bog down using the power BI maps that I've found. Something that I need to do some more research on ways of making the data fly without the need for sql scripts!
 

dchemist

Advanced User
Lifetime Premium Member
Joined
Jul 26, 2017
Messages
3,251
Reaction score
6,084
Age
41
Location
Benton, AR
Yeah this is cool and showing a lot of promise. It is slow but compared to what I accomplished you look like Einstein!
 

doubledge

PSL?
Beginner User
Joined
May 14, 2019
Messages
561
Reaction score
518
Big data can be cool! Using it to our advantage is the best way of enhancing the typical rat race of radar vs RD technology. LE is using it everyday. I think this is where the most potential progress is for CMs. This is what I love about all the RD companion apps. How they pull various sources of info together is great but only the beginning. I think we will see some pretty slick stuff in the near future.
 

turbofish

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Nov 2, 2018
Messages
301
Reaction score
620
Location
NW Arkansas
To be honest, I'm not really sure what big data is anymore. Every time I think I have a 'big' amount of data, I start working with something even larger. For example, the databases that I work with everyday at work, out of the two main databases [there are many, many more], there are over a trillion rows of data spread over related 350 tables. This one 'only' has 15 million rows. My weather database has around 77 million rows in the main table. All of this data has come from here and this is where I will use it to help this group.
Kind of strange perhaps. My wife has been at a dinner tonight which gave me the chance to work a couple more hours at the office working with databases but then I came come, I grabbed a big fat cigar while working this fun data on the porch and I came back inside to watch GoT [again] and relax to working with yet more data. Maybe I need a new hobby!
At work, during our stand up meetings, for a while I was doing nothing but fixing data. Not as easy as it sounds. It might take thousands of lines of code to fix one issue. One of my fellow programmers ended up making me an award.
This is a character from Star Trek named Data. His arm is broken. I'm fixing Data.

DataAward.jpg
 

Up All Night

Advanced User
Lifetime Premium Member
Joined
Nov 27, 2015
Messages
3,341
Reaction score
3,386
Location
Cleveland, OH
This is the kind of thing ecort should be doing with all the data they are sitting on. Probabilities.
Well done, very innovative


Posted from my iPhone using the RDF Mobile App!
 

sdrawkcaB

Defender of Light
Security
Advanced User
Lifetime Premium Member
Joined
Mar 6, 2018
Messages
4,506
Reaction score
8,773
Location
Here
So a few thoughts occurred to me. It'd be neat to run some scenarios with additional data.

I'm curious to know in the areas that are "cold", if a lack of reports may be related to poor or no cellular coverage? Take for instance the East-West road, "412" above the Ozark National Forest. I'd be curious if the lack of "heat" there is possibly related to any type of spotty cellular coverage.

Another view that would be interesting to see would be to map the location of LEO home-bases, where the LEO's start their days off at. I wonder if some of the "cold" areas are cold due to fewer LEOs there or not.
 

turbofish

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Nov 2, 2018
Messages
301
Reaction score
620
Location
NW Arkansas
I can create some new maps that have the ability to display a moving time line but unfortunately, I can't publish that one on line. As soon as I have time [been working killer hours lately] I can put the Power BI files on my site. Power BI is free from Microsoft and it would allow the user to play with it as they wish. It really is easy to understand
 

Badger

Advanced User
Premium Member
Joined
May 10, 2011
Messages
235
Reaction score
141
Location
224.0.0.6
Can you run zip 20176 if you have time?

Sent from my Pixel 3a XL using Tapatalk
 

sdrawkcaB

Defender of Light
Security
Advanced User
Lifetime Premium Member
Joined
Mar 6, 2018
Messages
4,506
Reaction score
8,773
Location
Here
I can create some new maps that have the ability to display a moving time line but unfortunately, I can't publish that one on line.
Is this a legal limitation or more of a technical limitation (not being able to export it easily)? If it's a technical limitation, I may be able to help you out.
 

turbofish

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Nov 2, 2018
Messages
301
Reaction score
620
Location
NW Arkansas
Technical limitation. The control, ArcGIS doesn't have a web based tool available.
 

sdrawkcaB

Defender of Light
Security
Advanced User
Lifetime Premium Member
Joined
Mar 6, 2018
Messages
4,506
Reaction score
8,773
Location
Here
Technical limitation. The control, ArcGIS doesn't have a web based tool available.
You could use this free open source screen recorder to capture the playback of your animated image, and then export it to a video file or an animated gif file to post here.

 

turbofish

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Nov 2, 2018
Messages
301
Reaction score
620
Location
NW Arkansas
Can you run zip 20176 if you have time?

Sent from my Pixel 3a XL using Tapatalk
Power BI
It will take a solid minute to load. Also discovered a new limitation of 30,000 locations so I had to limit it to only 20 miles. I'll get some more up later on that will cover missed areas using near by ZIPs
Post automatically merged:
You could use this free open source screen recorder to capture the playback of your animated image, and then export it to a video file or an animated gif file to post here.

I have used the built in Windows game recorder with limited success - will give this one a try
 

Tb12

PSL +5
Intermediate User
Joined
Aug 7, 2018
Messages
399
Reaction score
625
Location
MA
02101 (Boston) would definitely be interesting... Only problem is due to "safety" it's required police are on site for any construction that closes a lane or shoulder. Oh, and they're paid overtime. Luckily they're not allowed to leave to chase speeders...
 

turbofish

Learning to Fly
Beginner User
Lifetime Premium Member
Joined
Nov 2, 2018
Messages
301
Reaction score
620
Location
NW Arkansas
02101 (Boston) would definitely be interesting... Only problem is due to "safety" it's required police are on site for any construction that closes a lane or shoulder. Oh, and they're paid overtime. Luckily they're not allowed to leave to chase speeders...
Had to do some major pruning on this one since the initial query returned 500K rows and my map will only handle 30K locations!
Also had to use a different ZIP since there isn't a 02101 so I used 02109
Give it a solid minute to load

PowerBI ZIP 02109
 

G37X Jockey

Advanced User
Premium Member
Joined
Jul 22, 2012
Messages
1,373
Reaction score
1,232
Location
Behind my Steering Wheel
So a few thoughts occurred to me. It'd be neat to run some scenarios with additional data.

I'm curious to know in the areas that are "cold", if a lack of reports may be related to poor or no cellular coverage? Take for instance the East-West road, "412" above the Ozark National Forest. I'd be curious if the lack of "heat" there is possibly related to any type of spotty cellular coverage.

Another view that would be interesting to see would be to map the location of LEO home-bases, where the LEO's start their days off at. I wonder if some of the "cold" areas are cold due to fewer LEOs there or not.
Good point. Many map areas which appear "cold" could be overlaid with a cell coverage map. That would reveal that some "cold" areas are more accurately described as "no data", so for drivers, caution is advised.
 

Discord Server

Latest threads

Forum statistics

Threads
79,430
Messages
1,209,489
Members
20,137
Latest member
rhart
Top