DUST Search - Introducing DUST Charts -- A Data Driven Community Website

BGoat wrote:

Darth-Carbonite GIO wrote:

This is fantastic! How long did it take you to get it all working?

Thanks

Overall, it took about a month to get the site to a state that I felt was worthy of releasing to the public. About 30% of that time was spent on operational tasks, such as domain registration and configuration, setting up hosting, monitoring, tracking, etc. Another 30% of the time was spent on the back-end infrastructure for collecting the data, analyzing it, aggregating it and persisting it, and the internals of building and deploying releases of the application. The remaining 40% was all spent on building the user interface, integrating the front-end with external services and configuring the application.

There were a few stops and starts during that time while I was traveling, putting in long hours at work, adopting and taking care of a new puppy (wow, she is a handful Shocked

), etc. There were additional features I really wanted to finish before launching, but sometimes it's better to SHIP IT and iterate, versus trying to make it perfect from the very start.

In my day job, I primarily work on back-end infrastructure, so making the site look good was quite a challenge Smile

I'm trying to keep the site clean and easy for a user to look at without being overwhelmed by the sheer amount of information on the page, as is the case with many EVE sites out there. Hopefully, I am accomplishing that.

Feel free to use the buttons in the upper right to share the site on Facebook, Twitter or Google Plus if you know other people that may want to check it out. Cool

Pages: [1] 2 3 4 :: one page

Author	Thread Statistics \| Show CCP posts - 2 post(s)
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 130	Posted - 2013.10.06 19:26:00 - [1] - Quote Quick Link http://www.dustcharts.com Want to see what events are happening in Planetary Conquest, as they happen? Looking for an easy target to attack? Curious about which Alliances and Corporations hold the most districts? These are just a few of the questions you can find answers to on the DUST Charts website! Currently, the site is primarily geared toward Planetary Conquest, since the only data exposed through the CREST API is related to Districts in Molden Heath. However, as CCP exposes more API Endpoints to the public, a broader range of features will be developed and released. DUST Charts currently offers the following functionality: LIVE DASHBOARD Activity Feed Vulnerable Districts List Breakdown of Reinforcement Time for all Districts Count of Districts Under Attack, Generating Clones, Locked and Unlocked Current ISK Value of all Clones in Molden Heath DISTRICTS OWNERSHIP VISUALIZATION By Corporation By Alliance DISTRICTS SEARCH Great for searching for targets to attack! View all data for every district Sort by any field Filter results on the fly by typing in the Search box CORPORATIONS DASHBOARD Listing of all Corporations participating in Planetary Conquest Top 5 Greediest Corporations (highest tax rate) Top 5 Richest Corporations (based on current clone biomass value) Top 5 Largets Corporations (by member count) Top 5 Bullied Corporations (by number of districts under attack) All Corporations link to their own Corporation Overview page CORPORATION OVERVIEW Details Alliance membership CEO Tax Rate Member Count Districts Held Insights Total Clone count Total Clone capacity Total Clone Biomass Value Molden Heath Ownership Share Held Districts Reinforcement Time Breakdown Held Districts Infrastructure Type Breakdown District Holdings All data for districts held by Corporation Sortable and Searchable Recent Activity Only events pertaining to Corporation ALLIANCE DASHBOARD Listing of all Corporations participating in Planetary Conquest Top 5 Greediest Alliances (highest average tax rate of member corporations) Top 5 Richest Alliances (based on current clone biomass value) Top 5 Largets Alliances (by member count) Top 5 Bullied Alliances (by number of districts under attack) All Corporations link to their own Alliance Overview page ALLIANCE OVERVIEW Details Tax Rate Member Count Corporation Count Districts Held Insights Total Clone count Total Clone capacity Total Clone Biomass Value Molden Heath Ownership Share Held Districts Reinforcement Time Breakdown Held Districts Infrastructure Type Breakdown District Holdings All data for districts held by Alliance Sortable and Searchable Recent Activity Only events pertaining to Alliance Chat Embedded IRC Chat (#dust514 on irc.coldfront.net) In addition to what is listed above, some of the features coming soon include: Trending Dashboards (visualizing data over time) More Event Types in the Activity Feed Filter Activity Feed by Event Type Constellation, Solar System, Planet and District Dashboards and Overview pages Event Notifications -- Get an email when your corporation is attacked, loses a distrct, etc! And much more... Many nights and weekends were spent building DUST Charts in my spare time, so humor me and check it out if you haven't already http://www.dustcharts.com Any and all feedback is welcome and appreciated! Feel free to post in this thread or use the "Contact Me" button on the "About" page on DUST Charts to send me an email.
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 130	Posted - 2013.10.06 19:32:00 - [2] - Quote Reserving for future updates
Darth-Carbonite GIO Dust2Dust. Top Men. 186	Posted - 2013.10.06 19:56:00 - [3] - Quote This is fantastic! How long did it take you to get it all working?
21yrOld Knight Pradox XVI 166	Posted - 2013.10.06 20:23:00 - [4] - Quote Nice website i love it.
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 133	Posted - 2013.10.06 20:35:00 - [5] - Quote Darth-Carbonite GIO wrote: This is fantastic! How long did it take you to get it all working? Thanks Overall, it took about a month to get the site to a state that I felt was worthy of releasing to the public. About 30% of that time was spent on operational tasks, such as domain registration and configuration, setting up hosting, monitoring, tracking, etc. Another 30% of the time was spent on the back-end infrastructure for collecting the data, analyzing it, aggregating it and persisting it, and the internals of building and deploying releases of the application. The remaining 40% was all spent on building the user interface, integrating the front-end with external services and configuring the application. There were a few stops and starts during that time while I was traveling, putting in long hours at work, adopting and taking care of a new puppy (wow, she is a handful ), etc. There were additional features I really wanted to finish before launching, but sometimes it's better to SHIP IT and iterate, versus trying to make it perfect from the very start. In my day job, I primarily work on back-end infrastructure, so making the site look good was quite a challenge I'm trying to keep the site clean and easy for a user to look at without being overwhelmed by the sheer amount of information on the page, as is the case with many EVE sites out there. Hopefully, I am accomplishing that. Feel free to use the buttons in the upper right to share the site on Facebook, Twitter or Google Plus if you know other people that may want to check it out.
Darth-Carbonite GIO Dust2Dust. Top Men. 187	Posted - 2013.10.06 20:41:00 - [6] - Quote BGoat wrote: Darth-Carbonite GIO wrote: This is fantastic! How long did it take you to get it all working? Thanks Overall, it took about a month to get the site to a state that I felt was worthy of releasing to the public. About 30% of that time was spent on operational tasks, such as domain registration and configuration, setting up hosting, monitoring, tracking, etc. Another 30% of the time was spent on the back-end infrastructure for collecting the data, analyzing it, aggregating it and persisting it, and the internals of building and deploying releases of the application. The remaining 40% was all spent on building the user interface, integrating the front-end with external services and configuring the application. There were a few stops and starts during that time while I was traveling, putting in long hours at work, adopting and taking care of a new puppy (wow, she is a handful ), etc. There were additional features I really wanted to finish before launching, but sometimes it's better to SHIP IT and iterate, versus trying to make it perfect from the very start. In my day job, I primarily work on back-end infrastructure, so making the site look good was quite a challenge I'm trying to keep the site clean and easy for a user to look at without being overwhelmed by the sheer amount of information on the page, as is the case with many EVE sites out there. Hopefully, I am accomplishing that. Feel free to use the buttons in the upper right to share the site on Facebook, Twitter or Google Plus if you know other people that may want to check it out. I think it looks great, and I've already told my corpmates about it. Keep up the good work.
Vrain Matari ZionTCD 1027	Posted - 2013.10.06 21:09:00 - [7] - Quote Amazing job BGoat. Clean, slick, informative, intuitive. A hard act to follow, tbh. Well done.
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 135	Posted - 2013.10.06 21:46:00 - [8] - Quote Vrain Matari wrote: Amazing job BGoat. Clean, slick, informative, intuitive. A hard act to follow, tbh. Well done. Thanks for the kind words!
IAmDuncanIdaho II The Southern Legion The Umbra Combine 106	Posted - 2013.10.06 21:54:00 - [9] - Quote Nice work! I don't care about PC but it's great to see someone making use of the new CREST API. (I'm a programmer myself) Can't wait for them to add more data to it. I like what you've done - nice job!
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 135	Posted - 2013.10.06 22:35:00 - [10] - Quote IAmDuncanIdaho II wrote: Nice work! I don't care about PC but it's great to see someone making use of the new CREST API. (I'm a programmer myself) Can't wait for them to add more data to it. I like what you've done - nice job! Thanks! I'm really hoping we will get access to player data from matches. The amount of data may be very large, but I'd love the opportunity to tackle that big data problem. Maybe ingest it into Hadoop and use MapReduce to crunch some serious numbers. It would be interesting to build new leader boards that actually allow you to filter out the junk (unlike in the game -- seriously, who cares that a guy with 10 kills has a 10:1 k/d ratio?). It would also be possible to report on additional metrics like wp/death or custom metrics like what they have going on over at dust514stats. Really, any additional data that isn't exclusive to Planetary Conquest will make DUST Charts far more useful to the average player. Here's to hoping...

ReGnYuM TeamPlayers EoN. 952	Posted - 2013.10.06 22:43:00 - [11] - Quote I am impressed message me any char name and I will wire 100 Mill ISK to it.
R F Gyro Clones 4u 571	Posted - 2013.10.06 22:47:00 - [12] - Quote Very nice, good job there.
Karl Koekwaus Tronhadar Free Guard Minmatar Republic 190	Posted - 2013.10.06 22:48:00 - [13] - Quote That is one really nice looking site
Iskandar Zul Karnain Hellstorm Inc League of Infamy 1932	Posted - 2013.10.06 22:51:00 - [14] - Quote What a brilliant website! You've really done a fantastic job here. I am going to be making great use of this. Thanks.
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 137	Posted - 2013.10.06 23:11:00 - [15] - Quote ReGnYuM wrote: I am Impressed You will see a nice surprise in your wallet Wow Quite a surprise indeed! Thank you very much for your generosity ReGnYuM!
HowDidThatTaste Ancient Exiles 3719	Posted - 2013.10.06 23:29:00 - [16] - Quote This was Really needed!! Such a great job! this is going to be a great resource. It does a great job of bringing PC to life, this needs to be linked in game somehow. great job
The legend345 TeamPlayers EoN. 1151	Posted - 2013.10.06 23:47:00 - [17] - Quote Cool, but where are you coming up with the richest corp numbers?
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 140	Posted - 2013.10.07 00:02:00 - [18] - Quote The legend345 wrote: Cool, but where are you coming up with the richest corp numbers? The moniker "Richest Corporations" may be a bit misleading and I should probably think of a better description for that section. The numbers you see are calculated in a very simple manner, using the following data points: Total Clones Currently Possessed by Corporation (TC) Biomass Value of one Clone (BV) TC * BV = Clone Biomass Net Worth But that just doesn't have the same ring to it as "Richest Corporations" Obviously, I can't possibly know how much ISK a corporation or alliance has in their coffers, since I can't see into corporate wallets, so this is the next best thing for now. Soon, I will be exposing running totals for ISK profit from clone sales (last 24 hours, last week, last month, etc), which will probably be more interesting.
low genius the sound of freedom Renegade Alliance 629	Posted - 2013.10.07 00:09:00 - [19] - Quote great website. can't wait until you get more info from crest.
Poonmunch Sanguis Defense Syndicate 461	Posted - 2013.10.07 01:22:00 - [20] - Quote Really great stuff. Thanks a bunch. It helps me get a handle on what exactly is going on in PC and has taught me quite a bit. I can see that I was badly misinformed about what was going on. The site looks really crisp and uncomplicated. Thanks for doing this. Munch

The legend345 TeamPlayers EoN. 1159	Posted - 2013.10.07 01:33:00 - [21] - Quote BGoat wrote: The legend345 wrote: Cool, but where are you coming up with the richest corp numbers? The moniker "Richest Corporations" may be a bit misleading and I should probably think of a better description for that section. The numbers you see are calculated in a very simple manner, using the following data points: Total Clones Currently Possessed by Corporation (TC) Biomass Value of one Clone (BV) TC * BV = Clone Biomass Net Worth But that just doesn't have the same ring to it as "Richest Corporations" Obviously, I can't possibly know how much ISK a corporation or alliance has in their coffers, since I can't see into corporate wallets, so this is the next best thing for now. Soon, I will be exposing running totals for ISK profit from clone sales (last 24 hours, last week, last month, etc), which will probably be more interesting. I was gonna say... Has RND been hoein the rest of the alliance with a secret stash or what :O? LOL
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 142	Posted - 2013.10.07 02:45:00 - [22] - Quote Poonmunch wrote: Really great stuff. Thanks a bunch. It helps me get a handle on what exactly is going on in PC and has taught me quite a bit. I can see that I was badly misinformed about what was going on. The site looks really crisp and uncomplicated. Thanks for doing this. Munch I'm glad the site has been able to teach you things about Planetary Conquest! It is pretty cool to see just how organized certain Corporations are when it comes to managing the reinforcement times and infrastructure types of their districts. At one point, I think TeamPlayers had around 65 districts and had managed the reinforcement times to fall strictly within a 4-6 hour period each day, which I found impressive. I really didn't know much beyond the basics when it came to Planetary Conquest before I started building DUST Charts, so I definitely had a lot to learn along the way.
GHOSTLY ANNIHILATOR The Unholy Legion Of DarkStar DARKSTAR ARMY 540	Posted - 2013.10.07 02:59:00 - [23] - Quote Nice Bgoat i never knew about this good to know 1+
SgtDoughnut Red Star Jr. EoN. 258	Posted - 2013.10.07 03:32:00 - [24] - Quote Surprised I don't see chribba involved with this, but fantastic :D
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 144	Posted - 2013.10.07 07:47:00 - [25] - Quote Thanks for all of the positive feedback everyone, it is good to finally put this in the hands of the community and see it being used. Some good feedback I've received is that the clone sale events are a little spammy and drown out the rest of the events in the activity feed. Adding the ability to filter out certain events or event categories is high on my list, but not quite ready yet. While that functionality is still in development, I'm considering removing the Clone Sale events from the feed temporarily. If anyone disagrees and thinks those events should stay in the feed, let me know!
Funkmaster Whale 0uter.Heaven 749	Posted - 2013.10.07 11:04:00 - [26] - Quote This deserves a sticky, possibly in the War Room if anything.
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 158	Posted - 2013.10.07 16:23:00 - [27] - Quote Funkmaster Whale wrote: This deserves a sticky, possibly in the War Room if anything. I agree, this needs a sticky... somewhere Right now, the War Room makes a lot of sense, but I wouldn't want to pigeon-hole the site into something only players and corporations participating in Planetary Conquest will use. Very soon there will be more features for the average merc as well. Another option is to have a sticky in the Rookie Training Ground, to go along with other tools like the DUST Fitting Tool and Skill Planner offerings. It may be helpful for rookies to get exposed to events that are happening in PC and how it works. Another post in this thread indicated that the site was very helpful in that regard. And then, of course, there is General Discussion, which gets the most views and would hopefully introduce the site to more people. Having this thread stickied in GD to start and then moved to Rookie Training Ground or War Room at a later date may be the best option, but it is ultimately up to the CCP devs and community reps.
BGoat The Unholy Legion Of DarkStar DARKSTAR ARMY 158	Posted - 2013.10.07 19:24:00 - [28] - Quote FYI -- I have disabled the Clone Sales events in the global feed for now to reduce the clutter. They will gradually work their way out of the feed as new events come in. Note: I have left those events in the Corporation and Alliance feeds for now, as they may be more pertinent within those contexts.

CCP Nullarbor C C P C C P Alliance 2629	Posted - 2013.10.07 21:11:00 - [29] - Quote This is absolutely A+ execution, my hat goes off to you sir. This is why the New Eden community is the best gaming community, and why we should keep adding API's for you guys.

IgniteableAura Pro Hic Immortalis 194	Posted - 2013.10.07 21:28:00 - [30] - Quote Request glue...this is awesome



Pages: [1] 2 3 4 :: one page
First page \| Previous page \| Next page \| Last page