- What is d-portal?
- Which datasets are included in d-portal?
- What is IATI?
- What is OECD DAC CRS?
- Where does the data come from?
- Why is there data missing in some parts of d-portal?
- Why are there zeroes and dashes in the tables?
- When / how is data in d-portal updated?
- Where can I see more detail on IATI data quality issues/stats on how often organisations are publishing, etc?
- Where can I raise issues/questions about d-portal?
- Where can I see plans for future development, and make suggestions?
- How do I find out more about d-portal?
- What are common reasons for a organisation’s data not showing in parts of d-portal?
- What is d-portal? A view of all IATI (International Aid Transparency Initiative) data by recipient country or organisation, comparable with latest OECD DAC CRS (Creditor Reporting System) data.
- Which datasets are included in d-portal? IATI and CRS data (see below for more information).
- What is IATI? The International Aid Transparency Initiative - IATI is a voluntary, multi-stakeholder initiative that seeks to improve the transparency of aid, development, and humanitarian resources in order to increase their effectiveness in tackling poverty.
- What is OECD DAC CRS? The Organisation for Economic Co-operation and Development’s Development Assistance Committee Creditor Reporting System - which contains Official Development Assistance data.
-
Where does the data come from?
The IATI data comes from the IATI Registry.
The CRS data comes from CRS tables and stored on Github.
-
Why is there data missing in some parts of d-portal?
Organisations report their IATI data at varying degrees of detail, and data is updated and improved all the time by reporting organisations. If an organisation only publishes data for 2023, it won’t appear in 2024 columns/charts etc.
d-portal attempts to only reflect what is in the data and does not make corrections to data or information published to IATI, with only small exceptions to make the site user-friendly*
See also information about data quality (Afghanistan used as example)
-
Why are there zeroes and dashes in the tables?
Zeroes may denote issues with data quality (eg codes, dates, etc which are incompatible with the IATI Standard). There will shortly be links to the organisation’s page on the IATI dashboard to investigate specific data quality issues.
Dashes show that that donor/organisation is not currently an IATI Reporting Organisation.
-
When / how is data in d-portal updated?
Newly published files are updated every night, as well as a full re-import of all files. The re-import ensures that any external value that may have been changed; for example, exchange rates, will be applied to all relevant data. Data is pulled from the IATI Registry.
CRS data is downloaded annually when it becomes available and then stored in Github.
- Where can I see more detail on IATI data quality issues/stats on how often organisations are publishing, etc? See the IATI dashboard.
- Where can I raise issues/questions about d-portal? Either on our GitHub issues page or via support@iatistandard.org
- Where can I see plans for future development, and make suggestions? See milestones on GitHub issues page or contact us at support@iatistandard.org
-
How do I find out more about d-portal?
See the About page.
Look at the issues on GitHub.
Contact us - support@iatistandard.org
-
What are common reasons for a organisation’s data not showing in parts of d-portal?
Data that is marked as invalid IATI xml when using the Validator.
Mismatch between ‘Identifier’ in organisation’s profile in the IATI Registry, and reporting-org in that organisation’s data – this will show zeroes in the organisation’s data until the two are matched.
Transaction type code not present.
Not using either Disbursements or Expenditure in transaction type field.
Country and Sector graphs are displayed by adding up Transaction type codes 3 (Disbursement) and 4 (Expenditure) so activities without transactions or the right transaction type codes will not have these graphs.
Dates in incorrect format in the data.
Activities without end date are not shown on the list of projects ending soon or any lists that need an end date to order them.
The map section will not be shown if there are no activities with longitude and latitude data.
Illogical dates such as activity end date before activity start date.
No data relevant to the year being viewed on a pie chart or table (eg where a pie chart shows 2024 data and data published only relates to 2023).
If updating your Registry profile only, changes will show after the weekly full import (each weekend) as d-portal only updates nightly the data that has been changed in the xml.
- Which transaction types are used/not used in d-portal?
- How / where is the data tidied up before being displayed in d-portal?
- How is data apportioned to a specific year?
- What counts as a ‘missing project’?
- How are exchange rates calculated?
- What are the criteria for my organisation’s data appearing in recipient country charts/tables/maps in d-portal?
- Where do country codes/descriptions come from?
- What classifies something as an active, ended or planned project?
- How is the map data produced?
- How are US government organisations shown?
- Where does the data for Single Activity Viewer (SAVi) come from?
- Where can I find the code/README/project management information for d-portal?
- Where is the additional data for d-portal stored?
- When is ctrack updated?
- What counts as 2024 (chart) data?
- Why are sector aggregations using three-digit codes when five-digit codes are published?
- For the country and sector graphs on the acitivity pages, why have your changed them into bars?
- Why are some graphs missing for some types of transactions on the acitivity pages?
- Why are there less nodules on some of the graphs for transactions on the activity pages?
- Why are some data not showing up on the activity pages when they are available in the XML?
-
Which transaction types are used/not used in d-portal?
‘Expenditure’ and ‘Disbursements’ for Spend columns/data. If there are neither, but ‘Outgoing Commitment’ data exists, then the Outgoing Commitment data will be shown.
'Outgoing commitment' for Total commitment columns. If outgoing commitments have not been published, but Disbursement and Expenditure exist, then the sum of Disbursement and Expenditure will be shown.
‘Budgets’ in activity file, for Budget columns/data (eg in tables on d-portal) - if no budget data is present in the activity file, then ‘planned-disbursements’ are used if present.
-
How / where is the data tidied up before being displayed in d-portal?
- If a transaction date is not present, d-portal uses the transaction-value date in order to ascertain the date of a transaction (and therefore assign it to a specific year).
- Only displaying countries that exist in ISO3166 Alpha-2.
- Removing secondary organisations - flagged as secondary sources in IATI Registry - from tables (to avoid double counting, eg secondary organisations are for example UN-OCHA who re-publish data which would replicate data from those organisations in the same table - see here for list of secondary organisations excluded in these instances).
- Not displaying organisations with 0 datasets in the IATI Registry.
- If there are neither Expenditure nor Disbursement data but Commitment data does exist then the Commitment data will be displayed.
- In order to match against CRS data in tables, government departments are combined and shown under the country name - details of which departments are in Github.
- There are currently plans under consideration to use the lowest hierarchy level data only, should data at multiple hierarchies exist, in order to avoid double counting.
-
How is data apportioned to a specific year?
Using the transaction value date/transaction date (eg in Spend columns in tables).
Using the end date in the budget data (eg in Budget columns in tables).
-
What counts as a ‘missing project’?
Anything with invalid date ranges (eg start date after the end date).
Projects with invalid date ranges that cannot be placed in one of the other 3 categories (Active, Planned, Ended).
-
How are exchange rates calculated?
- Default USD
Currently (please note this may change soon) converting to USD using the exchange rate of the date specified in the value-date attribute. So when we display USD, it is very accurate to that date.
- Other currencies
For other currencies, the USD value is just converted using today’s exchange rate (please note this may change soon).
- For budget information in future?
Using the latest exchange rates (International Monetary Fund) every night and doing a full re-import once a week, so future budgets will use the current exchange rates and should be updated weekly.
- Default USD
-
What are the criteria for my organisation’s data appearing in recipient country charts/tables/maps in d-portal?
For charts - need a transaction with transaction date in the relevant year (the latest complete year, eg currently 2024) with a valid recipient country code or valid sector code, depending on which chart it is.
For tables - as above, with transaction date relating to the relevant year column in the table.
For maps - any transactions (from any year) with valid location tag and recipient country code (to be valid it needs to be on the relevant IATI codelists).
- Where do country codes/descriptions come from? This Wikipedia page with ISO codes.
-
What classifies something as an active, ended or planned project?
Activity start/end dates are used to work out which projects are active or ended or planned for the future.
- Active projects are projects with a start date in the past and with an end date in the future.
- Ended projects are projects with an end date in the past.
- Planned projects are anything with a start date in the future.
- How is the map data produced? Using ‘location’ tags within the data to plot projects on the maps - either lat/long or point/pos, depending on which the organisation uses.
- How are US government organisations shown? All collated under heading ‘United States’.
- Where does the data for Single Activity Viewer (SAVi) come from? These pages for individual activities come from IATI Registry.
- Where can I find the code/README/project management information for d-portal? https://github.com/devinit/D-Portal
-
Where is the additional data for d-portal stored?
Additional data is stored in Github, including
- list of Reporting Organisation IDs
- currencies
- exchange rates
- sector codes
- CRS data
- When is ctrack updated? Newly published files are updated every night, as well as a full re-import of all files. The re-import ensures that any external value that may have been changed; for example, exchange rates, will be applied to all relevant data.
- What counts as 2024 (chart) data? An activity which includes part of 2024 according to the activity’s start and end dates.
- Why are sector aggregations using three-digit codes when five-digit codes are published? Some organisations only produce data with 3 digit codes. We convert the 5 digit codes to 3 digits to unify the data for visualisation on d-portal.
- For the country and sector graphs on the acitivity pages, why have your changed them into bars? Google charts have deprecated these graphs - some country graphs are showing up as empty even when there is data in them. Bar charts allow users to see the data in relation to each other.
- Why are some graphs missing for some types of transactions on the acitivity pages? We're only showing graphs that have been published using the same currency. We've kept SAVi (Simple Activity Viewer) as simple as possible so there are no extra calculations made on the page, just displaying the raw xml as we get them.
-
Why are there less nodules on some of the graphs for transactions on the activity pages?
The transactions are merged if they are published for the same date.
The last transaction will stretch across the lifetime of the activity.
- Why are some data not showing up on the activity pages when they are available in the XML? We display machine-readable data where possible (ie. when we have codelists for those elements), narratives within these elements will not be displayed.
- What is EXPLORE?
- What does EXPLORE do?
- How can I use the filters?
- What is the data in the dropdown lists within filters?
- How can I use and refine the freetext search?
- How / what do the EXPLORE search results show?
- When doing a freetext search, what IATI fields are being searched?
- Do plural nouns work in freetext search?
- How does the Trending buttons work?
-
What is EXPLORE?
EXPLORE is made up of two parts – a series of filters, and a freetext box.
1. Filters
These are a selection of filters relating to the IATI Standard allowing users to choose and refine the IATI data they want to explore.
2. Freetext
This is a freetext box allowing users to search for themes and topics, and specific activities published to IATI.
- What does EXPLORE do? The EXPLORE feature is on the front page of d-portal.org and helps users find activities published to the IATI Standard based on keywords - it was originally developed to help people who wanted to find information on specific humanitarian crises.
-
How can I use the filters?
Select multiple filters from across the dropdowns. As you build a query using these filters the space underneath the filters will populate with an indication of how many activities are available to view based on your selections.
You can then click ‘Explore Results’ to find out more about those activities.
-
What is the data in the dropdown lists within filters?
Recipient Country and Reporting Organisation
The organisations that have published to the IATI Standard, and the countries where funds have gone to as published within IATI data.
Sector Group and Sector
The numeric codes and names to describe sectors within the OECD DAC CRS, as used within the IATI Standard.
Activity Status
The numeric codes and names within the IATI activity status field.
Year Range
Years from 1960 to ‘present year + 2’.
More filters
The numeric codes and names within the IATI activity status field. Click on Glossary to find out more about individual filters.
-
How can I use and refine the freetext search?
Type in one or more keywords and press enter to see how many activities have been found.
Click ‘Explore Results’ to see lists, graphs and maps allowing further exploration of the data.
Refine your search by adding multiple words – e.g. ‘Hurricane Matthew’ will find more refined (fewer) results than ‘Hurricane’.
- How / what do the EXPLORE search results show? Clicking ‘Explore Results’ provides results in the usual d-portal format (stats and charts which you can explore by clicking through to tables).
- When doing a freetext search, what IATI fields are being searched? This searches the Title and Description fields within all published IATI activities.
- Do plural nouns work in freetext search? EXPLORE is adapted for English plural nouns - e.g. typing ‘Refugee’ will include results for ‘Refugees’.
- How does the Trending buttons work? The COVID-19 button follows the IATI Publishing Guidance. It currently searches the database for COVID-19 in title and description fields and looks for the relevant codes in the humanitarian-scope element.
- What is it? The Generator is a tool to help users to reproduce data from d-portal in other webpages/blogs.
- Why does it exist? To help users who want to display their own data, or data they are interested in, within their own website/blog.
-
How do I use it?
Make selections from the dropdown menus and C&P the code provided into your webpage’s html.
For more information see http://www.d-portal.org/news/2014-11-30-Interactive-IATI-data-d-portal-generator.html
- How often will the generated content on my webpage update? It’s dynamic, so will update automatically overnight. If you change your data, this will be reflected. So when you’ve got content from the generator in your site or blog post, it will change accordingly!
-
How reliable is it?
The embedded data in your blog post / website will stay up as long as the d-portal site is up (eg permanently).
The only time this can go wrong is if your website provider disallows you to include external widgets in your blog posts, ie. if you can embed a youtube video into your blog post, you can embed generator content in your post.
-
Help! I'm trying to create the widget in my company's internal website but it's not working.
Both secured and non-secured HTTP access is enabled and supported on d-portal. This should let users on secured domains use Generator content.
Use https://d-portal.org/ctrack.html#view=generator instead.
If you are unsure if this affects you, see if your company's website uses https:// instead of http:// in the website address.