Anatomy of Federal Business Opportunities on a Big Data platform using AWS Elastic Map Reduce on HADOOP

That’s right, beginning August 12, 2016, Fedmine is the first federal data aggregator to begin using Hadoop for powerful analytics on federal spending data sets!

  1. Automate your searches to unearth federal opportunities within specific areas of interest
  2. Configure your alerts using any number of search elements, receive alerts for IDIQ contracts and task orders
  3. Obtain real-time competitive intelligence on solicitations prior to their release, monitor daily FPDS-NG awards
  4. Track your federal market segments to stay ahead of your competition like never before
  5. Obtain federal business intelligence, opportunity intelligence, and agency intelligence before bidding on any opportunity
DAILY FBO OPPORTUNITIES WITH ALERTS VIA EMAIL Opportunities for all categories of RFPs (pre-solicitations, combined-solicitations, mods, special notices, awards, property etc.) released daily, with original SOWs, Questions and Answers, and modifications etc. when released by the government. Powerful configurable search templates provide automation of keyword alerts, codes, location, and more. Federal Contract Opportunities interlinked and cross aggregated by Agency, Contracting Office, Zip Code, Posted Date, Classification Code, NAICS Code, Set-Aside, and linked to most GAO Protests and filings when possible Yes
DAILY GRANTS OPPORTUNITIES Opportunities for all categories of grants, procurement contracts, cooperative agreements released daily Yes
FAADS DATABASE Federal Assistance Award Data on all Grants in comparative 7 year views. Rotational Analysis by CFDA, County, State, Zip Code, Recipient & more Yes
FBO HISTORY SEARCH Searchable RFPs dating back to 2001 for referencing past solicitations in comparison to new opportunities for better understanding. Awards linked to FPDS data wherever possible Yes
ONE-CLICK CROSS LINKS ON FBO DATA ELEMENTS WITHIN RFPs Cross-referencing of all FBO opportunities released by response date, NAICS code, Zip Code, Classification Code, Set-Aside Type and other criteria with just one click. Allows you to jump to any RFP document type, filter by agency and contracting office, or by sub data elements within RFPs for horizontal access across all agencies or vertical drill down to access individual contracting offices. Yes
DAILY GAO PROTEST DECISIONS GAO protests integrated into FBO, including full text of GAO decisions, and cross linked to each protesting company's Fedmine Company Profile. Yes
DAILY FBO KEYSTATS Tabulation of all RFP document types with unprecedented details on a daily basis. All opportunities nested by industry sector, year to date for each industry code, top agency for each industry code and number of opportunities released. One-Click drill down allows access to all FBO individual document types with multiple cross links to various filters from one screen. View new and past RFPs with original SOW documents and reducing FOIA requests. Agency Contacts linked to all RFPs by Contracting Officer and RFPs released from 2001 to present Yes
KEYWORD SEARCH ACROSS ALL FBO DOCUMENTS Search RFPs by keyword, such as “rfid”, “law enforcement”, “recovery act”, etc., to go beyond NAICS Codes. Create your own One-Click Access for each keyword to all federal business opportunities (Alerts to opportunities as is available from Fedbizopps will be available in a few days) Yes
FBO INTEGRATION WITH FPDS-NG FBO integration with FPDS-NG contract awards data connects awards released on FBO to FPDS-NG. Difficult integration between key disparate databases allows subscribers to view elements of an opportunity chain with timely and vital historical perspectives for measuring win probabilities. Fine tuning bid /no bid strategies early results in cost reductions. Yes
COMPANY-WIDE OPPORTUNITY COLLABORATION &VISIBILITY Opportunities tagged by a single user automatically show on the screens of other authorized users within the company. The ability to share this information enhances decision making, collaboration, and the pursuit of timely partnerships for teaming. Reduces time spent in trying to apprise everyone concerned for the pursuit of opportunities. Yes
ORIGINAL LINKS Links to all original SOW documents via links provided and established by the federal government Yes
FEDERAL AGENCY PROFILES Federal Agency Business Intelligence, Reports, Contacts and more… Yes
DAILY FEDERAL CONTRACT AWARDS IN REAL TIME A total of 8 DAILY Real Time Reports showing Key Award Stats from the previous day with drill down to each contract award. Some of these reports include: TODAY'S TOP SMALL BUSINESS CONTRACTORS, TODAY'S TOP CONTRACTING OFFICES, TODAY'S TOP AWARDS BY NAICS CODES, BY AGENCY, AND TODAY'S TOP CONTRACTORS Yes
AGENCY TOP LEVEL MARKETVIEW Consolidated market views of each Agency consisting of aggregated data for Top Industry Sectors by NAICS & PSC, Top Contracting Offices, Small Business (with auto-refresh filters for socioeconomic types), Top Contractors, Top Congressional Districts, Top Competition Categories, Top GSA and IDV Vehicles, and Today's Opportunities. Drill down from each with view box. Yes
KEYSTATS All federal opportunities nested by industry sector, year to date totals for each code, top agency purchasing under that code, and opportunities released by the top agency. Yes
OMB EXHIBIT 53 OPPORTUNITIES Searchable OMB Exhibit 53 of funded IT Opportunities in a lightning fast mini database utility with Agency Profiles with keyword search. Provides viewing funded programs with Project IDs across three fiscal years for strategic business development and pre-RFP intelligence Yes
KEY FEDERAL CONTACTS LINKED TO INDIVIDUAL RFPs Federal Assistance Award Data on all Grants in comparative 7 year views. Rotational Analysis by CFDA, County, State, Zip Code, Recipient & more> Agency Acquisition Officer Contacts: Name, Title, Address, Zip, Email, Phone, Fax. All Contacts connected to RFPs & Awards released by theme. Contacts database refreshed daily. Over 62,000 unique contacts, search by NAICS Code, or RFPs released by socio status and many more elements Yes
MULTI-TIERED DRILL DOWN BY CONTRACTING OFFICE WITH ROTATIONAL ANALYSIS Specialized Horizontal & Vertical One-Click Drill Down on all Contract Awards not just at the Agency or Bureau level, but right down to each Contracting Office. Each analysis level provides more Horizontal & Vertical expenditure analysis by NAICS & PSC Codes, including County and Socioeconomic breakdown at each Contracting Office level. This we call full Rotational Analysis on Contract Awards Yes
INDUSTRY SECTOR REPORTS BY NAICS / PSC Individual Expenditure Profiles for each Individual NAICS and PSC Code with drill down to Top Contractors for each individual Code. Cross links from Prime Contractor Profiles provide One-Click Market Views for on-the-fly assessments Yes
CONTRACTOR REPORTS WITH SUB-FILTERS FOR SOCIO CATEGORIES Lightning fast execution of reports, run individual or combined Socioeconomic sub-filters to quickly locate Small Businesses, live hover view reveals all their Socioeconomic categories instantly. One-Click to view their Profiles from the report Yes
GEOGRAPHIC REPORTS BY NESTED BY INDUSTRY SECTORS Uniquely nested One-Click queries to all contracting data in 7 year Comparative Views providing Horizontal and Vertical drill throughs with filters for all Socioeconomic Categories. Easy One-Click filters for viewing each State and list of Contractors comprising dollar totals. Discover Competitors and Teaming Partners by Geographic Location, by State, County, Congressional Districts and each Socioeconomic Category Yes
EXPIRING CONTRACTS BY UNBILLED AMOUNTS Easily uncover Expiring Contracts for Re-Compete information, full with Unbilled Amounts for each Contract. Instantly view Contracts expiring by GWAC type (Seaport, Alliant, Networx etc), and identify by dollar range, Contract Ceiling Amount, NAICS, PSC, Socio category, specific Contracts Issue Year, and more Yes
DAILY FEDERAL CONTRACT ACTIONS REGISTER Daily Federal Contract Actions Register that provides 11 important columns of actionable information. This report is viewable separately by Agency and Vendor. Date and year filters provide rapid filtering for select date range analysis to keep tabs on competitors and contracting offices issuing those contracts. Each column directly links to contract award details Yes
Federal Competitive Intelligence: By Industry Sector, Agency, Competition Type, GWAC, with graphs, and more
COMPARATIVE 11 – Year FEDERAL CONTRACTOR PROFILES WITH DYNAMIC GRAPHS Comprehensive Federal Prime Contractor Profiles on approximately 600,000 Companies with Contracting data presented in Comparative 7 year detailed views on all contracting actions, including GSA & IDV Contracts, with breakdown by Competition Type. Powerful drill down to each individual contract from on screen hyperlinks often exceeding 2,000 live links on very large profiles. Includes up to 100 company specific data elements such as; CEO, Email Address, 8a /HubZone dates, Org Type, Fiscal Year, GSA Schedule/ IDV Vehicles, Quality Assurance, NAICS & PSC Codes, and more. Profiles include One-Click reports for breakdown of company sales by Industry sectors, Contracting Offices, Competition, Potential Federal Market by Contractor, and much more. Yes
UNIFIED COMPARATIVE 11 – Year PARENT COMPANY VIEWS WITH SUBSIDIARIES Unified data views on each Parent Federal Contractor with each subsidiary visible from one page in Comparative years, includes all data elements present in regular Contractor Profiles. Twelve dynamically generated graphs, one set of 6 shows market breakdown for Parent Contractor By Agency, the other set shows market share of each subsidiary. View each subsidiary and its contracts without leaving the Parent Profile page, or click its DUNS number for full company analysis Yes
POINT & CLICK SAVE FEATURE AUTO-CATEGORIZES INFORMATION FOR RETRIEVAL Point and Click on links for saving vital pieces of information, then see that information appear under your MyFedmine menu automatically categorized for easy retrieval and downloading. Download free PDF reports across the entire application suite, or email reports to colleagues. Track potential partners, competitors, contracting offices, contacts, RFPs, referrals, or create your own One-Click Custom Templates with company specific search criteria Yes
CORPORATE HISTORY A history icon on each Prime Contractor Profile shows changes to corporate data on # of employees, annual revenue, and more. Pre-analyzed data minimizes need to search endlessly, a number of One-Click reports link to comparative 7 year historical views from all profiles to gauge patterns by contracts won, opportunities won when responding to FBO Solicitations Yes
HORIZONTAL & VERTICAL MARKET ANALYSIS WITH DYNAMIC 11 YEAR GRAPHS (H /V & R Analysis) Easy identification of specific contracting actions by contracting office, by subsidiary, by NAICS or PSC Code, By IDV Vehicle or GSA Schedule. Multi-tiered drill down to actions by Socioeconomic Status with filters for Geographic Location, Agency and Bureau, and much more. H /V & R Analysis is the process of viewing data in a manner that allows multi-tiered drill down into data that is cross-linked to other tables for fast data manipulation. For example, viewing all Agency procurement data in columns of comparative years containing aggregate numbers for all years would be doing a Horizontal Analysis. A Vertical Analysis would require deep drill down into Agency Bureaus & Contracting Offices, Rotational Analysis would be performed when you apply sub-filters like Geographic Location and Socio Status Indicators horizontally at each Vertical drill down level for analysis Yes
REPORTS LIBRARY – SEVERAL THOUSAND POINT & CLICK REPORTS A library of well over 8,000 reports allows unique iterations and manipulation of data without configuring any search templates. Many are unique, like showing first-timer contractors winning business from the government, and contracting offices issuing by county and industry sector type. Easy links allow immediate drill down to transaction details, award amounts, Contracting Offices issuing the contracts, and horizontal cross links to contacts involved in making similar purchases Yes
USER CUSTOMIZATION OF ONE-CLICK REPORTS Powerful saving features throughout the application, even after running a search, allows users to configure their own One-Click reports when they see results, and run them later from their MyFedmine saved items menu Yes
FEDPOINT Federal prime contractor locations integrated with Google Maps, FIPS 55 Data, to County and Congressional Districts, and GIS Long/Lat FedPoint data Yes
Why our service is different…unique, and nobody comes close to being a close second?
REAL TIME FEATURES Enterprise Class Database with High Availability Enabling Rapid Analytical & Operational Judgements Yes
AGGREGATION ENGINE Out technology aggregates real time information on a daily basis with the goal of helping enable optimal business strategies. The daily information we aggregate provides the most up to date comprehensive views of distilled data that vastly reduce complexity and help gain valuable understanding of hard details immediately. Data from authoritative government sources is deeply integrated for providing timely insights into federal spending activity like never before. All numbers are hyper-linked for quick drill down in all reports. An intuitive interface links entities to each other with relative ease. Yes
AUTHORITATIVE FEDERAL GOVERNMENT DATA SOURCES WE OBTAIN OUR DATA Federal Procurement Data (FY 2010, 09, 08, 07, 06, 05, 04 (00-03 avail.), OMB Exhibit 53 (IT spending details from OMB), Federal Business Opportunities Feed (from, Grants Opportunities database (from, GSA Schedule Contract Actions (GSA Schedule numbers from GSA are cross-linked to FPDS-GSA Transactions), GAO Protest Decisions (from GAO), FAADS (Federal Assistance Award Data from Census Bureau), Company contacts (from CCR & SBA), Federal Government Contacts (federal solicitations, federal websites, and various authoritative government sources), Budget data (from GPO, White House, and OMB) Yes
REAL TIME WEB SERVICES Web Services tie directly into the live database from various data sources (see below) to enable high availability of data only a database capable of showing real time can use. Smart indexing on key columns within database for creating custom rotational analysis and variations to existing reports. Multiple iterative variations such as filtering by socio status, location, industry sector, agency, contracting office, vendor etc. possible on most reports. Yes
OPTIMIZATION ENGINE All data is obtained nightly from disparate but authoritative federal government data sources. A powerful data normalization and optimization engine updates over a million records on a daily basis for our clients without any manual intervention for true real time data! This technical capability is unmatched in the industry, because legacy database architectures of other providers cannot compete without reinventing and re-innovating their front and back end applications. This we do not envisage happening any time soon. Yes
DIRECT NIGHTLY DATA FEED INTO LIVE SERVER Data is obtained nightly from disparate but authoritative federal government data sources. A powerful data normalization and optimization engine updates over a million records on a daily basis for our clients without any manual intervention! This technical capability of ours is unmatched in the industry Yes

To make federal business opportunities easier for others, a business intelligence provider must have first hand knowledge of pursuing government contracts. That experience can only be acquired if at some point in your past you single-handedly bootstrapped your own government contracting firm and ran it successfully for many years, grew it to a hundred plus employees, and had the epiphany of wanting to make the process easier for every one. There needs to be this social cause for doing this with a passion. At Fedmine we can say that all of the above holds true for us, but can any other provider claim similar credentials? We do not believe so.