Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added ship_traffic AIS example #130

Merged
merged 46 commits into from
Jan 27, 2021
Merged
Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
3cd06bc
Added ship_tracking AIS example
jbednar Jan 19, 2021
a2b994e
Formatting
jbednar Jan 19, 2021
4e60d0f
Added usecols to speed up CSV reading
jbednar Jan 19, 2021
6517ff4
Doubly persisting speeds up rendering 3-10x
jbednar Jan 19, 2021
c44c260
Allow larger npartitions
jbednar Jan 19, 2021
95c9d76
Update loading code
philippjfr Jan 19, 2021
1e7f1c1
Fixed example datatype
jbednar Jan 19, 2021
4e21651
Force pyarrow version 2 for orders of magnitude speedup
jbednar Jan 19, 2021
18da375
Persist categories
philippjfr Jan 19, 2021
4b845c1
Pull out usecols
jbednar Jan 19, 2021
2871d4a
Now collects vessel info (for hover/drilldown) alongside pings
jbednar Jan 20, 2021
bee294c
Removed unnecessary HTML at the top of the notebook
jlstevens Jan 20, 2021
7eb460c
Removed unused imports
jlstevens Jan 20, 2021
136c358
Added inspect_points operation to notebook overlay
jlstevens Jan 20, 2021
3bc853f
Updated text. Moved inspection/highlight to the final app
jbednar Jan 20, 2021
42a4912
Renamed ship_tracking to ship_traffic
jbednar Jan 20, 2021
c1e8602
Made message match behavior
jbednar Jan 20, 2021
f481779
Added points_transformer to join data in Points hover
jlstevens Jan 21, 2021
7b4f163
Improve ship_traffic
philippjfr Jan 21, 2021
05d6e88
Filtering vdims in transformer functions
jlstevens Jan 21, 2021
6e6a8da
Added drilldown table with URL
jlstevens Jan 21, 2021
3e2b1a9
Improved selection table and added sliders
jbednar Jan 22, 2021
0882d89
Removed duplicate versions of files
jbednar Jan 22, 2021
7ba5494
Added photo pane
jlstevens Jan 22, 2021
9f3f830
Updated text and comments. Made spatial indexing optional. Used tinyu…
jbednar Jan 23, 2021
d175360
Simplified AIS category descriptions
jbednar Jan 24, 2021
87d1ec0
Updated .yml
jbednar Jan 24, 2021
d384e9f
Simplified hit and photo handling
jbednar Jan 24, 2021
4bc27b2
Made .yml whitespace match anaconda-project auto-generated formatting
jbednar Jan 24, 2021
c6fb013
Cleaned up title formatting
jbednar Jan 24, 2021
f2870db
Added max_hits slider
jbednar Jan 24, 2021
d8cd573
Added static plots of predefined locations
jbednar Jan 25, 2021
467b3a0
Fixed broken link
jlstevens Jan 25, 2021
4c18e18
Centered photos and improved formatting of MMSI value
jlstevens Jan 25, 2021
6c62014
Updated notebook to use improved inspector API
jlstevens Jan 26, 2021
94093c2
Update ship_traffic to use latest inspect API
philippjfr Jan 26, 2021
4eda90e
Fix duplicate photos for repeated points from same ship
jbednar Jan 27, 2021
fe45be7
Set up test data and initial tap location
jbednar Jan 27, 2021
6cb074a
Show legend before categorical plots
jbednar Jan 27, 2021
7d56465
Set up data access
jbednar Jan 27, 2021
0c176d8
Fixed path
jbednar Jan 27, 2021
3a57799
Pinned to dev releases
jbednar Jan 27, 2021
3578877
Use pyviz/label/dev
jbednar Jan 27, 2021
c267893
Fix typo in .yml
jbednar Jan 27, 2021
495dbda
Fixed flakes
jlstevens Jan 27, 2021
118dc50
Temporarily skipping small_data_cleanup step
jlstevens Jan 27, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
282 changes: 282 additions & 0 deletions ship_tracking/AIS_categories.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,282 @@
num,desc,category,category_desc
0,Not available,0,Unknown
1,Reserved,0,Unknown
2,Reserved,0,Unknown
3,Reserved,0,Unknown
4,Reserved,0,Unknown
5,Reserved,0,Unknown
6,Reserved,0,Unknown
7,Reserved,0,Unknown
8,Reserved,0,Unknown
9,Reserved,0,Unknown
10,Reserved,0,Unknown
11,Reserved,0,Unknown
12,Reserved,0,Unknown
13,Reserved,0,Unknown
14,Reserved,0,Unknown
15,Reserved,0,Unknown
16,Reserved,0,Unknown
17,Reserved,0,Unknown
18,Reserved,0,Unknown
19,Reserved,0,Unknown
20,"Wing in ground (WIG), all ships of this type",1,WIG
21,"Wing in ground (WIG), Hazardous category A",1,WIG
22,"Wing in ground (WIG), Hazardous category B",1,WIG
23,"Wing in ground (WIG), Hazardous category C",1,WIG
24,"Wing in ground (WIG), Hazardous category D",1,WIG
25,"Wing in ground (WIG), Reserved for future use",1,WIG
26,"Wing in ground (WIG), Reserved for future use",1,WIG
27,"Wing in ground (WIG), Reserved for future use",1,WIG
28,"Wing in ground (WIG), Reserved for future use",1,WIG
29,"Wing in ground (WIG), Reserved for future use",1,WIG
30,Fishing,2,Fishing
31,Towing,3,Towing
32,Towing: length exceeds 200m or breadth exceeds 25m,3,Towing
33,Dredging or underwater ops,4,Dredging
34,Diving ops,5,Diving
35,Military ops,6,Military
36,Sailing,7,Sailing
37,Pleasure Craft,8,Pleasure
38,Reserved,0,Unknown
39,Reserved,0,Unknown
40,"High speed craft (HSC), all ships of this type",9,High Speed
41,"High speed craft (HSC), Hazardous category A",9,High Speed
42,"High speed craft (HSC), Hazardous category B",9,High Speed
43,"High speed craft (HSC), Hazardous category C",9,High Speed
44,"High speed craft (HSC), Hazardous category D",9,High Speed
45,"High speed craft (HSC), Reserved for future use",9,High Speed
46,"High speed craft (HSC), Reserved for future use",9,High Speed
47,"High speed craft (HSC), Reserved for future use",9,High Speed
48,"High speed craft (HSC), Reserved for future use",9,High Speed
49,"High speed craft (HSC), No additional information",9,High Speed
50,Pilot Vessel,10,Pilot Vessel
51,Search and Rescue vessel,11,Search and Rescue vessel
52,Tug,12,Tug
53,Port Tender,18,Passenger
54,Anti-pollution equipment,13,Industrial
55,Law Enforcement,14,Law Enforcement
56,Spare - Local Vessel,15,Spare
57,Spare - Local Vessel,15,Spare
58,Medical Transport,16,Medical Transport
59,Noncombatant ship according to RR Resolution No. 18,17,Noncombatant
60,"Passenger, all ships of this type",18,Passenger
61,"Passenger, Hazardous category A",18,Passenger
62,"Passenger, Hazardous category B",18,Passenger
63,"Passenger, Hazardous category C",18,Passenger
64,"Passenger, Hazardous category D",18,Passenger
65,"Passenger, Reserved for future use",18,Passenger
66,"Passenger, Reserved for future use",18,Passenger
67,"Passenger, Reserved for future use",18,Passenger
68,"Passenger, Reserved for future use",18,Passenger
69,"Passenger, No additional information",18,Passenger
70,"Cargo, all ships of this type",19,Cargo
71,"Cargo, Hazardous category A",19,Cargo
72,"Cargo, Hazardous category B",19,Cargo
73,"Cargo, Hazardous category C",19,Cargo
74,"Cargo, Hazardous category D",19,Cargo
75,"Cargo, Reserved for future use",19,Cargo
76,"Cargo, Reserved for future use",19,Cargo
77,"Cargo, Reserved for future use",19,Cargo
78,"Cargo, Reserved for future use",19,Cargo
79,"Cargo, No additional information",19,Cargo
80,"Tanker, all ships of this type",20,Tanker
81,"Tanker, Hazardous category A",20,Tanker
82,"Tanker, Hazardous category B",20,Tanker
83,"Tanker, Hazardous category C",20,Tanker
84,"Tanker, Hazardous category D",20,Tanker
85,"Tanker, Reserved for future use",20,Tanker
86,"Tanker, Reserved for future use",20,Tanker
87,"Tanker, Reserved for future use",20,Tanker
88,"Tanker, Reserved for future use",20,Tanker
89,"Tanker, No additional information",20,Tanker
90,"Other Type, all ships of this type",21,Other
91,"Other Type, Hazardous category A",21,Other
92,"Other Type, Hazardous category B",21,Other
93,"Other Type, Hazardous category C",21,Other
94,"Other Type, Hazardous category D",21,Other
95,"Other Type, Reserved for future use",21,Other
96,"Other Type, Reserved for future use",21,Other
97,"Other Type, Reserved for future use",21,Other
98,"Other Type, Reserved for future use",21,Other
99,"Other Type, no additional information",21,Other
100,Reserved for future use,0,Unknown
101,Reserved for future use,0,Unknown
102,Reserved for future use,0,Unknown
103,Reserved for future use,0,Unknown
104,Reserved for future use,0,Unknown
105,Reserved for future use,0,Unknown
106,Reserved for future use,0,Unknown
107,Reserved for future use,0,Unknown
108,Reserved for future use,0,Unknown
109,Reserved for future use,0,Unknown
110,Reserved for future use,0,Unknown
111,Reserved for future use,0,Unknown
112,Reserved for future use,0,Unknown
113,Reserved for future use,0,Unknown
114,Reserved for future use,0,Unknown
115,Reserved for future use,0,Unknown
116,Reserved for future use,0,Unknown
117,Reserved for future use,0,Unknown
118,Reserved for future use,0,Unknown
119,Reserved for future use,0,Unknown
120,Reserved for future use,0,Unknown
121,Reserved for future use,0,Unknown
122,Reserved for future use,0,Unknown
123,Reserved for future use,0,Unknown
124,Reserved for future use,0,Unknown
125,Reserved for future use,0,Unknown
126,Reserved for future use,0,Unknown
127,Reserved for future use,0,Unknown
128,Reserved for future use,0,Unknown
129,Reserved for future use,0,Unknown
130,Reserved for future use,0,Unknown
131,Reserved for future use,0,Unknown
132,Reserved for future use,0,Unknown
133,Reserved for future use,0,Unknown
134,Reserved for future use,0,Unknown
135,Reserved for future use,0,Unknown
136,Reserved for future use,0,Unknown
137,Reserved for future use,0,Unknown
138,Reserved for future use,0,Unknown
139,Reserved for future use,0,Unknown
140,Reserved for future use,0,Unknown
141,Reserved for future use,0,Unknown
142,Reserved for future use,0,Unknown
143,Reserved for future use,0,Unknown
144,Reserved for future use,0,Unknown
145,Reserved for future use,0,Unknown
146,Reserved for future use,0,Unknown
147,Reserved for future use,0,Unknown
148,Reserved for future use,0,Unknown
149,Reserved for future use,0,Unknown
150,Reserved for future use,0,Unknown
151,Reserved for future use,0,Unknown
152,Reserved for future use,0,Unknown
153,Reserved for future use,0,Unknown
154,Reserved for future use,0,Unknown
155,Reserved for future use,0,Unknown
156,Reserved for future use,0,Unknown
157,Reserved for future use,0,Unknown
158,Reserved for future use,0,Unknown
159,Reserved for future use,0,Unknown
160,Reserved for future use,0,Unknown
161,Reserved for future use,0,Unknown
162,Reserved for future use,0,Unknown
163,Reserved for future use,0,Unknown
164,Reserved for future use,0,Unknown
165,Reserved for future use,0,Unknown
166,Reserved for future use,0,Unknown
167,Reserved for future use,0,Unknown
168,Reserved for future use,0,Unknown
169,Reserved for future use,0,Unknown
170,Reserved for future use,0,Unknown
171,Reserved for future use,0,Unknown
172,Reserved for future use,0,Unknown
173,Reserved for future use,0,Unknown
174,Reserved for future use,0,Unknown
175,Reserved for future use,0,Unknown
176,Reserved for future use,0,Unknown
177,Reserved for future use,0,Unknown
178,Reserved for future use,0,Unknown
179,Reserved for future use,0,Unknown
180,Reserved for future use,0,Unknown
181,Reserved for future use,0,Unknown
182,Reserved for future use,0,Unknown
183,Reserved for future use,0,Unknown
184,Reserved for future use,0,Unknown
185,Reserved for future use,0,Unknown
186,Reserved for future use,0,Unknown
187,Reserved for future use,0,Unknown
188,Reserved for future use,0,Unknown
189,Reserved for future use,0,Unknown
190,Reserved for future use,0,Unknown
191,Reserved for future use,0,Unknown
192,Reserved for future use,0,Unknown
193,Reserved for future use,0,Unknown
194,Reserved for future use,0,Unknown
195,Reserved for future use,0,Unknown
196,Reserved for future use,0,Unknown
197,Reserved for future use,0,Unknown
198,Reserved for future use,0,Unknown
199,Reserved for future use,0,Unknown
200,Reserved for future use,0,Unknown
201,Reserved for future use,0,Unknown
202,Reserved for future use,0,Unknown
203,Reserved for future use,0,Unknown
204,Reserved for future use,0,Unknown
205,Reserved for future use,0,Unknown
206,Reserved for future use,0,Unknown
207,Reserved for future use,0,Unknown
208,Reserved for future use,0,Unknown
209,Reserved for future use,0,Unknown
210,Reserved for future use,0,Unknown
211,Reserved for future use,0,Unknown
212,Reserved for future use,0,Unknown
213,Reserved for future use,0,Unknown
214,Reserved for future use,0,Unknown
215,Reserved for future use,0,Unknown
216,Reserved for future use,0,Unknown
217,Reserved for future use,0,Unknown
218,Reserved for future use,0,Unknown
219,Reserved for future use,0,Unknown
220,Reserved for future use,0,Unknown
221,Reserved for future use,0,Unknown
222,Reserved for future use,0,Unknown
223,Reserved for future use,0,Unknown
224,Reserved for future use,0,Unknown
225,Reserved for future use,0,Unknown
226,Reserved for future use,0,Unknown
227,Reserved for future use,0,Unknown
228,Reserved for future use,0,Unknown
229,Reserved for future use,0,Unknown
230,Reserved for future use,0,Unknown
231,Reserved for future use,0,Unknown
232,Reserved for future use,0,Unknown
233,Reserved for future use,0,Unknown
234,Reserved for future use,0,Unknown
235,Reserved for future use,0,Unknown
236,Reserved for future use,0,Unknown
237,Reserved for future use,0,Unknown
238,Reserved for future use,0,Unknown
239,Reserved for future use,0,Unknown
240,Reserved for future use,0,Unknown
241,Reserved for future use,0,Unknown
242,Reserved for future use,0,Unknown
243,Reserved for future use,0,Unknown
244,Reserved for future use,0,Unknown
245,Reserved for future use,0,Unknown
246,Reserved for future use,0,Unknown
247,Reserved for future use,0,Unknown
248,Reserved for future use,0,Unknown
249,Reserved for future use,0,Unknown
250,Reserved for future use,0,Unknown
251,Reserved for future use,0,Unknown
252,Reserved for future use,0,Unknown
253,Reserved for future use,0,Unknown
254,Reserved for future use,0,Unknown
255,Reserved for future use,0,Unknown
1001,Fishing vessels,2,Fishing
1002,Fishing vessels,2,Fishing
1003,Freight Vessels,19,Cargo
1004,Freight Vessels,19,Cargo
1005,Industrial vessels,13,Industrial
1006,Miscellaneous vessels,21,Other
1007,Offshore drilling vessels,13,Industrial
1008,non-vessel,21,Other
1009,non-vessel,21,Other
1010,Offshore supply vessel,13,Industrial
1011,Oil Recovery vessel,13,Industrial
1012,Passenger ships,18,Passenger
1013,Passenger ships,18,Passenger
1014,Passenger ships,18,Passenger
1015,Passenger ships,18,Passenger
1016,Public freight,19,Cargo
1017,Public tankship/barge,20,Tanker
1018,Unclassified public vessel,0,Unknown
1019,Recreational Vessel,8,Pleasure
1020,Research Vessel,21,Other
1021,SAR Aircraft,21,Other
1022,School ship,21,Other
1023,Tank Barge,20,Tanker
1024,Tank Ship,20,Tanker
1025,Towing Vessel,3,Towing
63 changes: 63 additions & 0 deletions ship_tracking/anaconda-project.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,63 @@
# To reproduce: install 'anaconda-project', then 'anaconda-project run'
name: ship_tracking
description: Visualizing AIS tracking data for ships near the USA
maintainers:
- jbednar
labels:
- datashader
- holoviews

user_fields: [labels, skip, maintainers]

channels:
- pyviz

packages: &pkgs
- bokeh ==2.2.3
- colorcet ==2
- dask ==2020.12.0
- datashader ==0.12.0
- holoviews ==1.14.0
- notebook ==6.1.5
- numba ==0.51.2
- numexpr ==2.7.1
- pandas ==1.1.5
- panel ==0.10.3
- python ==3.7.9
- spatialpandas ==0.3.6
- xarray ==0.16.2
- pip ==20.3.3

dependencies: *pkgs

commands:
dashboard:
unix: panel serve ship_tracking.ipynb
supports_http_options: true
notebook:
notebook: ship_tracking.ipynb
test:
unix: pytest --nbsmoke-run -k *.ipynb --ignore envs
windows: pytest --nbsmoke-run -k *.ipynb --ignore envs
env_spec: test
lint:
unix: pytest --nbsmoke-lint -k *.ipynb --ignore envs
windows: pytest --nbsmoke-lint -k *.ipynb --ignore envs
env_spec: test

variables: {}
downloads:
DATAFILE:
url: https://zenodo.org/record/3541812/files/HG_OOSTENDE-gps-2018.csv
filename: data/HG_OOSTENDE-gps-2018.csv

env_specs:
default: {}
test:
packages:
- nbsmoke=0.2.8
- pytest=4.4.1
platforms:
- linux-64
- osx-64
- win-64
Loading