Let there be Database Rows
The only edits that I had to make to the project code were the database connection details in scraper.ini and a narrowing down of ship classes listed in toaster_shiplist.json. After getting the data into mySQL and importing the invTypes and mapSolarSystems tables from the static dump into my database, I could start to filter and sort the results.
Kicking off the scraper:
pi@charon ~/eve_prosper $ python zkb_scraper.py — startdate=2013-12-01DB Connection: GOODzKillboard connection: GOODno crash log found. Executing as normal…Parsed Capital Industrial Ship: [200, 29713239, 0, ‘2013-04-08’] sleep=20.0Parsed Capital Industrial Ship: [290, 27468307, 1, ‘2012-12-30’] sleep=20.0
Here is the query to get Racial JFs and also include the solar system name and security value:
— Get Racial JFs
SELECT destruction_data.date, destruction_data.week, destruction_data.typeID, destruction_data.systemID, destruction_data.destroyed, invTypes.typeName, mapSolarSystems.solarSystemName, mapSolarSystems.security
ON (destruction_data.typeID = invTypes.typeID)
ON (destruction_data.systemID = mapSolarSystems.solarsystemID)
WHERE destruction_data.typeID IN (28850, 28844, 28848, 28846)
ORDER BY destruction_data.date DESC
Out of 975 Jump Freighter kills covering 334 days, there is an average of 20 a week killed. It turns out that you are most likely to get caught in Lowsec in a Rhea.
When we look at kills by system, Purjola (0.5), a Highsec system in the Forge stands out as the system with the most losses at 54. Not surprisingly the Lowsec system of Sagain (0.4) comes in second, most likely due to the terrible kickout station that I have covered here.
More coming soon as I start to think of what types of statistics and trends I can pull out of the data. If you have something you would like me to look at, please leave a comment or tweet @K162space.
Successful invasion campaigns are run by competent FCs that have logistical backbones with access to intelligence. This dynamic can also be said about large-scale industrial projects; combining the talents from multiple pools can produce very profitable results. Liquid ISK, assets, production management, market intelligence, and a dash of luck are all needed to have great results with industry.
Over time I’ve been running copy jobs on my Obelisk BPO and performing invention jobs on the side. This collection has been growing and has caused an itch that needed to be scratched. I wanted to see these items get produced.
Lockefox @HLIBIndustry and I have been talking about a collaborative project for a few months and we finally got around to narrowing down the scope and details of the collaborative operation.
We combined my assets with Lockefox’s production management and market analysis skills in order to combine our efforts to produce multiple Jump Freighters. Within a few days Lockefox had worked out a four month production timeline stretching from the end of April until August. Not small-scale by any means as we were placing multi-billion amounts of materials into a month long production timeline.
The three Obelisk BPCs were put into invention to net more Anshar runs, but the Invention Fairy said ‘hello no’ with three failures coming in for each invention job. Overall invention success rate for Anshar jobs is coming in at 16.7%.
More updates will come as we run through the production process. Lockefox got the initial project post out yesterday so also watch his blog for updates.
My side interest in information aesthetics is present in my work, both professional and personal. I’ve received many comments on how clean and clear my analysis charts, reports, and spreadsheet work can be so I though I would share some of my Eve related spreadsheet work to inspire people.
Here are screenshots from depreciated spreadsheets that I used for industrial production, speculation, and fuel estimations before switching to a custom web-based solution that my partner, Raath, created.
My design goal has always been to use small type-face Arial text that is boxed and columned with important information highlighted in primary colors or shaded in gradients to denote best to worst status. Some of these sheets are old with broken formulas or outdated build requirements. Pay more attention to the organization rather than to the numerical content.
The best way that I have found to make money for the lest amount of effort is stocking nullsec hubs. Forget mining, mission running, invention, or any type of item or ship production. If you spend time doing market research, planing your logistics, reducing your risk, and monitor sales you can make far much more than any other type of activity in Eve.
What follows is a guide for stating up your own operation to stock the warchests of eager PVP pilots (at a profit of course).
I’m using three years of trade and logistics experience to help me outline the operation. Your style may differ, but here is the outlay that has worked for me time and time again despite political change.
If you can parse information in the form of Dotlan map statistics, notice price disparity between two locations, have a basic understanding of jump mechanics, learn to avoid common ganking techniques, and maintain a basic level of proficiency in Nullsec politics you can easily break into this style of gameplay.
Buy low in Jita, move things to nullsec, and sell for a profit. To grow bigger take the profits generated and reinvest in your operation to increase its product scope and logistical power.
In order to properly reach several places and reduce the amount of midpoint jumps, you will need Jump Drive Calibration V. If you don’t have this yet, go train it as it is one of the most valuable skills for jump capable pilots.
Start-up capital may vary. I started my operation with 2 B ISK and have grown from there so tailor the scope of the operation to your level.
- Always look to reduce risk. This extends from not putting too much ISK into the operation in case it fails, not getting a hauling ship ganked, keeping assets under your control, or even not telling people about your timetable and route for logistics.
- Because time is money you want to reduce time sinks. The end goal for this operation is to spend as little time as possible managing it and more time doing other activities. For me that meant more market research and blogging, but for the majority of people I imagine funding endless PVP activity is the goal.
- Improve sales by using a program to produce reporting and business intelligence out of your data. EVE HQ, Eve Mentat, or EMMA are all good solutions, but I spent a lot of time flexing my PHP muscle to build my own wallet manager. Goonswarm has built their own import tool called Goonmetrics for people that lack the technical expertise of setting up databases and operating code.
Finding a suitable hub depends on many factors including traffic, location, and the ease of logistics getting into the destination system.
- To maximize your ISK velocity, find a place with a lot of traffic. Use the filters on Dotlan and the in-game map to discover numbers for the number of pilots docked and jumps per 24 hours. Major nullsec hubs will standout on the filter with thousands of jumps per day.
- Find an Alliance and location that is politically stable. When assets are moved into a conquerable station, you run the risk of loosing access to that station. If this happens, you will need to keep your trade alt docked and either slowly sell off your items or firesale them to quickly liquidate. Do keep in mind that without notice major shift in power can occur; look up the history of Band of Brothers or GoonSwarm to discover how powerful the click of a mouse button can be.
- Consider the logistical hurdles to getting to the destination station. More midpoints means more time spent doing logistics and the lack of midpoint stations can mean the use of alternative jumping methods as outlined in the Jump Technique #2 section.
- Check cynojammer status for your destination and midpoint systems. Some alliances will jam their system to reduce the likely hood of enemy capitals entering. Others alliances won’t care and have found joy in the opportunity of a large-scale capital engagement in their home system (ie Titan battle of August 15 in K-6K16).
- Alliances have many CTAs so get on Jabber, look at forum posts, or talk to PVP people about where they are staging. You want to stock where things are blowing up. Note: stocking a staging station for a campaign is very risky and I would not recommend this type of stocking for people that lack heavy logistics to move goods out at a moments notice due to the sometimes fickle nature of alliance leadership decisions and campaign politics.
The more cyno alts the better. Moving characters around will cost time and slow you down. In my operation I have 5 cyno capable alts around the galaxy that shift depend on where I am currently operating.
A trade alt will remain pertinently docked in the Nullsec destination system and only exit station to light the occasional cyno.
I have a character in Jita that holds ISK and does all of the purchasing. This helps isolate all the purchases to one character to keep my bookkeeping tidy.
The goal of the operation is to move items from a Highsec trade hub, to a Highsec station system next to a Lowsec station system, and then into Nullsec by means of either zero or many midpoints.
This illustration shows two legs on the operation. The Highsec and Lowsec activity can be handled by a NPC character while the Midpoint and Nullsec end is dedicated to your Alliance character.
I use Jump Freighters in this example, but based on your capital the number and types of ships, each setup will vary. When I started my operation I used standard Industrial ships to get around Highsec, a Blockade Runner to get into Lowsec, and a Carrier to perform the cyno operations into the destination system.
Logistics Stage 1: Product Selection
There are many ways to find profitable items and I’ve already published some of the things that are very volatile in nullsec in this post.
Logistics Stage 2: Getting out of Jita
A proper Jita insta-undock bookmark is a valuable things. Using this will reduce a large amount of your risk as it will place you off of the Jita undock grid within seconds.
Logistics Stage 3: Getting Across Highsec
There are many options for transporting across Highsec that include doing it yourself or outsourcing with services such as Red Frog Freight. The volume, time, available capital, and risk will dictate what method to use.
If you are just beginning your operation, you will have to be frugal and move items with a Industrial. Later you can move on to Blockade Runners (Crane, Prorator, Viator or Prowler) since their cargo area is unscannable as of the Retribution patch.
Though scannable, an Orca has a large tank and can be used to transport larger amounts of goods than Blockade Runners. Freighters do have a large amount of capacity, but they are often targets for ganking activity. If money is no object, choose to use a NPC Jump Freighter to move items as they offer a larger amount of HPs and align faster than normal Freighters.
Logistics Stage 4: Getting from Highsec to Lowsec
This move can be done with standard Industrials, Blockade Runners, Orcas, Freighters or Jump Freighters. The riskier methods involve scouting the gate on the Lowsec end and moving goods only when clear.
The fastest m3 per time method is to have your goods staged in Highsec in the adjacent system, light a cyno on the Lowsec station, jump to Lowsec, dock, unload, undock, align to the Highsec gate, and enter warp when you reach velocity returning to the Highsec system to begin the cycle again.
Note that I stated to align and not Warp To as a method for killing Jump Freighters is to bump or web reducing the maximum speed below the current speed, effectively locking you in the Warp operation. Read up on the ‘Vindicator Triple Web’ exploit if want to know more about this exploit. If you don’t issue the Warp To command and are aligning, at any sign of trouble you can dock.
Logistics Stage 5: Getting Across Lowsec
Use the Station to Station technique outlined later.
Logistics Stage 6: Getting Across Nullsec
Use the Station to Station technique outlined later.
Logistics Stage 7: Destination System
The D2-HOS system in Pure Blind was FA’s capital system and jammed. The best route in was jumping into a adjacent system and scouting the gate. Higher risk, but at the time it was worth it.
Before Widly Innapropirate were absorbed into GoonSwarm, they homed in G8AD in Cloud Ring. They had an active beacon. If you scouted the system and had Carrier backup, your risk was reduced.
The best method is to find a major Nullsec hub that lacks a jammer so your trade alt can undock, light a cyno within docking range, and let your ship land right within docking range. This technique reduces your risk to almost nothing if done properly.
Jump Technique 1: Station to Station Jumps
The most efficient, low risk method of moving items between Lowsec <-> Lowsec, Lowsec <-> Nullsec, or Nullsec <-> Nullsec system is to have two characters in two systems light cynos within docking range of each respective station.
The Jump Freighter will jump in, dock, unload, undock, and jump back to the original cyno. If you are quick, you can get 5-6 jump cycles under one cyno timer. Done efficiently this method can move around 1,750,000 m3 per cyno depending on your Freighter skill level and racial Jump Freighter, both which affect the ship’s cargo capacity.
Jump Technique 2: POS Container Jumping
If you absolutely cannot get a station system as one of your midpoints, you can use a riskier method using an anchored container and a POS with a Cynosural Generator Array module. The goal with this method is to jump in and warp to 100 km to the anchored container, landing you inside the POS shields.
If done correctly, you will only be vulnerable for a few seconds as your ship aligns and warps withing the POS shields. I do, however, recommend that you only jump into the system when it is empty with a character in the system to monitor activity. There is still a chance of an enemy logging off next to the Cynosural Generator Array and logging back in as they see you leave the originating system, but it is low.
When I would perform this type of operation I had a Carrier on standby within jump range of the POS system. If anything went not according to plan, the Carrier came into system to serve as support while the POS guns fended off the attacker or Alliance reinforcements arrived.
Jump Technique 3: Right Out of Jita
A quick, lowrisk method for moving billions out of Jita involves bypassing Highsec altogether as a large number of systems are jump accessible right out of the Jita undock as seen here.
Using this technique, you can put a large amount of ISK into your NPC Jump Freighter and bypass the deadly gank systems of Uedama and Niarja.
Here are two route examples of when I would stock for the former Northern Coalition. The three Lowsec systems of Chardalane, Maut, and Oulley served as three options for extending myself into Nullsec as they were each Lowsec station systems with a connection to contiguous Highsec. If either system was busy with cyno popping pirates, I would switch to one of the other two options.
- Buy things in Jita and place 5-10 B in a Courier Wrapped Freighter Container on my Jita purchasing character.
- Undock with a NPC freighter character and move to Adacyne, the Highsec system next to Chardalane.
- Use a NPC Jump Freighter to move goods from Adacyne into Chardalane Lowsec.
- Use a Alliance Jump Freighter to jump into D2-HOS or G8AD-C.
- Hand off goods to my Trade alt in the station and price items for sale.
If you look back at any of my monthly reports, you can review the success of my efforts. My recommendations for people that want to get involved with Nullsec trade and production is to always keep one eye on Nullsec politics. Take notice of who is attacking, defending, advancing, and maintaining homogeneity; the key to your success is situational awareness.
As my hulking Charon docked in a quiet Amarr outpost, I started to organize the incoming shipment of minerals, PVP goods, and invention items.
I was getting ready to start the invention jobs for two more Anshar BPCs, but then I realized I had forgot something.
Damn, I forgot to buy the decryptors.
The use of decryptors on invention jobs for large-ticket items such as Jump Freighters, Marauders, and Black Ops is almost mandatory if you want to have high profit margins.
I’ve found that using Collision Measurements is the best type for Jump Freighter invention. Here is the breakdown on how the use of decryptors affects the end profitability of building a Jump Freighter with 4-4-4 skills.
Over the course of the past few months, I’ve built up a small collection of Anshar -1/-1 BPCs for a rainy day. Owning the BPO for the Obelisk, the Capital part components for the freighter, and the Advanced Capital Construction Component Blueprints greatly improves the final profit.
If you want to know more detailed information on the build process, read the Building a Jump Freighter post.
In addition to trading, I’ve started up a small invention and Tech 2 production line. My initial approach is to start small and see how well items perform. For now I am going to be working with drones, bombers, and some popular modules. I’ve invented a few ships, but am holding off on producing them.
I’m saving the invention job history to my database and wrote a small display to show overall and individual item invention success rates. I’ll add this summary to my monthly updates as I’m sure inventors will find it interesting.
My first Jump Freighter invention job was successful despite the ~39.8% calculated success rate given my 4-4-4 skills.
Attempting the job cost 36.3 M of items that are destroyed regardless of the job output:
1x Collision Measurements – 7.6 M
64x Mechanical Engineering Datacore – 7.231 M
64x Gallente Starship Engineering Datacore – 21.438 M
Obelisk BPC – Copied from my BPO
Since I am not actively producing Freighters due to their low markup and currently dropping mineral prices, I put the Obelisk BPO back into an open copy slot. It takes around 43 days for one copy in an empire slot so you can see why Jump Freighters are slow to produce.
Further details of Jump Freighter production can be found here.
Today we celebrate as we add Jump Freighter #4 to the fleet. This brings our operation to around 1,400,000 m3 of moving capacity per jump.
Prices for these ships have gone nothing but up in the past two years and peaked with the massive amounts of speculation when Drone minerals were removed. The Ark was purchased in 2011-02 at ~4.7 B, which seems almost cheap compared to current prices.