I’ve spent a lot of time designing API driven KPI style dashboards for my industrial operations and given the industry changes coming as detailed in the Summer 2012 CSM7 minutes, I want to share my designs to (hopefully) inspire people for upcoming Winter expansion (I wonder if CCP’ers read this blog).
My mission statement with these was to use a clean, elegant format to give a high level display into my industry operations while using Eve icons and market prices. I should be able to tell the materials and price/profit for items at a glance without referring to other menus, applications, or looking up historical prices.
The below shot is active industry jobs. I want to know what is being used, who is using it, current and future ME/PE/Copy numbers, and a pretty display for the job progress.
Another dashboard that I created was capital jobs only. Since these jobs were so long, I wanted to be able to see them progress on a calendar. This has allowed me to keep idle blueprints busy and schedule large-scale builds since capital jobs require large amounts of minerals.
Though the current Eve client does display industry jobs, I find it to be inelegant.
The information displayed is all text, almost like I was reading a database table. Also, I am constantly switching between filter options as the window does not remember my past settings.
When I experimented with supplementing my POS network with PI items, I wanted to be able to display my PI network. I needed to know who owned the item, what is was producing, the output quantity, and how much ISK/day that operation was making.
Additionally, I did some work with the database table for PI items (wonderful self-referencing table) to show me what items up the PI T0 to T3 tree I can currently make given what I am extracting. The page ends up being quite long as it displays all tiers so I cropped this shot after T2. The red marks next to the T1 items mean that I don’t have the T1 items in stock so I can’t make the resultant T2 item.
This is a great example of my ‘high level’ approach. I can now easily answer the question of “can I make Robotics?”. No, I need to be making this at T1 and this at T2. I don’t have to spend time looking at blueprints and their requirements — no additional pages or reference material.
Tech 2 Production
Tech 2 manufacturing can get quite complicated. I was spending a lot of time checking what I had in stock, the build requirements, and final costs. This page gives me the ability to simply move a blueprint from the left column (stock) to the right (build queue) and it queries the database to display everything that I need to make that item.
Multiple blueprints can be added to the queue and materials are aggregated together. This allowed me to place all my blueprints in a queue and create a shopping list of things I need to create the run.
The same story continues for capital ships. I can select my BPO/BPC, the ME level, the character producing it, and the production station. When the location is picked the bottom panes pull from the assets and tell me what I have in stock and what I need in order to complete the job.
I want to see a reduction in the amount of clicks and an increase in the amount of user feedback and intelligence given to the user. The displays should not just be a simple static display. They should be more dynamic — pull from your inventory when you select a production system and tell me what I need, display a build quote that doesn’t require me to have all the items or know their build requirements, and use the new Inferno universal market price for items.
More Power to the People
The propose of this short guide is to empower a person that has limited or no experience working with the Eve dataset to perform queries and extract useful information.
Eve has two main data sets. The first is the static data that is published by CCP and updated with each expansion. This set contains information that doesn’t change such as stargate coordinates, number of Moons in VFK-IV, type of research agents in the Forge, or the minerals requirements for a Drake.
The other set is the dynamic data, which is exposed through the API. This data contains the types of assets you own, wallet transactions, or kill statics for a particular system — things that change and things that go boom.
More Data, More Problems
With every new release, CCP publishes a Microsoft SQL database backup file of their static data. You can find the most up to date file on the Community Toolkit website.
Along with the database backup, you will find other useful downloads such as images for every item in Eve — very important when trying to create something presentable out of boring database tables if you are designing a 3rd Party application.
Some people do not use Microsoft SQL and opt to run their database with MySQL, the most popular opensource database package. This format is not released by CCP and thus enterprising players routinely convert the data from Microsoft SQL to MySQL format. Nothing is lost, just converted.
Usually a few hours after a new file has been posted on the Community Toolkit site, people have conversions up for download. If you hang out in the Eve Technology Lab sub-forum, people will usually post links once available. I have been getting my releases from this site: http://zofu.no-ip.de/.
Noise. has written an excellent guide on how to install the free version of Microsoft SQL Server and work with CCP’s database backup file in order to get to a point where you can run a database query.
Table Prefix Nomenclature
The naming format of the tables is very intuitive and can be picked up fairly quickly.
|agt||all about agents both mission and research|
|chr||character information such as bloodlines, factions, and races|
|crp||NPC corporation divisions|
|dmg||damage attributes, effects, dogma (attribute system)|
|eve||basic information for icons and units|
|inv||market groups, item details, item reactions. I do a lot of work with these tables|
|map||xyz data, landmarks, regions, solar systems connections, and general universe data|
|planet||planetary interaction schematics|
|ram||industry, manufacturing, refine|
|sta||station services, xyz docking locations|
Tips and Tricks
An item’s typeID is a very important thing to know. This is a unique number that identifies a type of object in Eve.
Keep in mind that referring to a Drake (typeID 24698 in the static dataset) will be different than referring to your Drake (unique itemID 1002615059065 in the API feed). The itemID value is a unique number that identifies every object in Eve (1).
Eve Queries 101
SELECT * FROM [dbo].[invTypes] WHERE typeID = 24698 GO
List all Battlecruisers
SELECT * FROM [dbo].[invTypes] WHERE groupID = 419 GO
Eve Queries 201
PI Schematics are contained in the planetSchematicsTypeMap self referencing table. This means that the build requirements for P0, P1, P2, and P3 are all contained in one table. The isInput column is used to list build requirements when set to 1.
1. Listing all P0 items using the isInput value set to 0.
SELECT planetSchematicsTypeMap.*, invTypes.typeName FROM planetSchematicsTypeMap JOIN invTypes ON (planetSchematicsTypeMap.typeID = invTypes.typeID) WHERE planetSchematicsTypeMap.isInput = 0 AND invTypes.marketGroupID = 1335 ORDER BY invTypes.typeName
2. Listing items that go into Construction Blocks, a P1 with typeID 3828 and schematicID 74.
SELECT planetSchematicsTypeMap.*, invTypes.typeName FROM planetSchematicsTypeMap, invTypes WHERE planetSchematicsTypeMap.typeID = invTypes.typeID AND schematicID = 74 AND isInput = 1
Eve Queries 301
CCP’s dataset does not contain a table with Tech2 build requirements. We have to create a new table that combines information from a number of tables and then work off the new table.
1. Run this pastebin query once to create your new typeBuildReqs table. If successful, you will get a message like this:
(15791 row(s) affected).
2. Find the build requirements for a Cap Recharge II with input typeID of 2033 (Cap Recharge II Blueprint). The NOT IN statement excludes the skills required to build the item.
SELECT typeBuildReqs.*, invTypes.typeID, invTypes.typeName FROM typeBuildReqs JOIN invTypes ON (invTypes.typeID = typeBuildReqs.requiredTypeID) WHERE typeBuildReqs.typeID = 2033 AND invTypes.groupID NOT IN (268,269,270) AND activityID = 1
If you want some more example queries, comment or find me on twitter.
(1) If you remember that old Devblog post about Drake missile lag, one major component to the lag was that every missile fired had to have a unique itemID created and destroyed after it exploded. This database operation ate up a lot of time, which is critical to a simulation trying to play through a battle.
Following the trend of EVE-fail, I am going to continue releasing monthly financial reports.
November saw a resurgence of trading as the anticipation of Crucible brought me back into the game. With all the PI changes, there were ample opportunities to turn a profit. The change over to Player Owned Offices meant a tax barrier and therefore an increase to PI goods. Now that PI goods are involved in many production chains (POS’es, POS modules, T2 components), there has been an increase across the board.
New to the net value charts is the inclusion of Corp assets as I have taken the CEO role and put a lot of ISK into our ventures.
Here is a sneak-peak at my top trading groups. As you can see Implants far outweigh the other items. When a person goes to replace their implants, you are not only selling 1 implant, but 4 or maybe 5, as people will replace the entire set.
I have not tested the market with Skill Hardwiring implants but now that they are visible on killmails, I may have to parse what ones are popular. Expansions always bring new trading opportunities, you just have to look for them. I might write something to scrape killmails and give me a report on what are the top 10 by volume per month.
There was a large growth in November compared to October due to a renewed effort into trading. I expect that December will be a good month as the introduction of the new Tier 3 Battlecruisers opens up many avenues. They are going to be popular and will die quickly.
Another iteration of PI is coming to the server. The existing Office structures in orbit around planets in lowsec, nullsec, and wormhole space will disappear. Players will have to build their own player-controlled Offices in order to move PI items on and off of planets. Note: Highsec will not be affected.
For 6,000 Concord LPs and 20 M ISK, you can get one Customs Office Gantry BPC. Interesting move that the BPO will not be released. This means that people will have to continually engage in Concord LP activities such as Incursions or Faction Warfare.
Jester went into detail about the gameplay changes due to the hit point values, reinforcement timer options, and LP requirements, but I wanted to cover the market aspects of the changes. You might be able to make a lot of money off of the changes. When PI was first introduced, I was able to turn 2 B into around 5 B by playing the speculation game.
Disclaimer: Everything I say and quote could be entirely wrong so do your own research.
As soon as the devblog was posted, the market speculators began to buy up the component items. The consensus is that when this goes live all existing PI in lowsec, nullsec, and wormhole space will be affected. There is going to be a delay to get the new Customs Offices in place because people will have to obtain a BPC from the Concord office, build the Gantries, and anchor them in place. Additionally, there will be a wave of people that will consider this effort to high and give up on their existing PI production. Prices for the parts that made the Gantries, items for POS fuel, and T2 production are going to increase.
|Manufacturing the Customs Office Gantry||Upgrade to Customs Office|
|Integrity Response Drones: 5
Organic Mortar Applicators: 10
Sterile Conduits: 14
Capital Construction Parts: 1
|Broadcast Node: 8
Recursive Computing Module: 8
Self-Harmonizing Power Core: 8
Wetware Mainframe: 8
If you want some hard speculation numbers, a 40-60% increase short-term in the first few months and a general 20% increase over the long-term seems reasonable to me. Take a look at the speculators in action in The Forge.
Now is not a good time to have to buy POS fuel. I hope you have 6 months to a year in reserve!
So, on the morning of Tyrannis, my alarm went off at the start of downtime. Like all the rest of the bandwagon nerds, I sat and waited while CCP toyed with my frustration, until I was finally able to get online. Since the skills were seeded, my freighter alt’s been training command center upgrades, my scan alt and pos manager have center upgrades and interplanetary consolidation to IV, w/ the scan alt also picking up advanced planetology III.
A comparison of no planeology skills vs advanced planetology III:
However, somewhere along the line I forget to get the scan alt into anything bigger than a frigate. So, while he can use level IV command centers, he couldn’t fit them in his ship and thus deploy them until I had made a pit stop for some meta 3 cargo expanders and stripped an old salvage catalyst.
With that minor hurtle over and the two litres of creme soda already half empty I started PI. Six to eight hours later, I had built all ten colonies, demolished two thirds of them, rebuilt them better, demolished half of those, rebuilt, ectera, until I got sick of placing links.
Still not happy with them, as my first road trip to jita revealed that I should be mainly focusing on t1 processing and leave t2 processing to the freighter alt. I’ll fix that once I can stand to look at a command center without having to stop myself from closing Eve.
Along with a year of NPC pos fuel (divided down to a month and a half amoungst eight poses), which was about 650 mil (I forget), about 1 bil of reaction profits and various sleeper bits (100 mil), I sold four days of PI material for about 40 mil.
So, profits a bit…meh, but no-one can say anything until the NPC buy and sell orders are removed. Which they have been. So no-one can say anything until the vast stockpiles run out and we start depending on PI to keep, well, everything running.
Again, I honestly didn’t expect much income if any from something with no upkeep besides clicking required to keep it running, but the number of clicks is ridiculous. I clicked so many times that my index finger grew a pair of wrists and started cutting itself in a misguided attempt to make me stop.
So, give it a week or four and we’ll see how the market reacts to the economic equivalent of getting a spin kick to the back of the legs.
P.S. Every time I think “hey, this would make a nice post”, Letrange has already covered it, more thoroughly than I could have from an analyzing standpoint. So, I’m a bit short of ideas. Suggestions?