ANO Round (#3) - Instructions for Standing Parties on Scoring Process

ANO Selection Process

Thank you for your participation in the ANO selection process so far by reviewing the submitted information and asking questions.

This post is to advise of the next steps in this ANO selection round (Round #3)

Differences for this ANO selection round
First, we will highlight the following significant differences in this ANO selection round:

1. For this ANO selection round we have new scoring arrangements, whereby the Standing Parties provide 60% of the votes, and the Guides provide 40% of the votes for the Subjective and Technical aspects respectively.

2. The Standing parties will be required to consolidate their score, per candidate, into a single number between 0 and 60 -- whereas the Guides will be required to consolidate their score, per candidate, into a single number between 0 and 40.

3. The scores provided by the Standing Parties are to only cover the aspects defined in the Subjective subjects and the scores provided by the Guides are to only cover the aspects defined in the Technical subjects.

4. Scoring is to be on the basis of the responses to the formal questions, supplementary information provided via file uploads, and answers to ad-hoc questions posed during the questioning period.

5. The PDF extracts within each ANO candidate's thread, and the Google sheets provided below, breakdown the scores into categories with recommendations for the marks per category -- but this is only advisory.

6. The policy agreed by the Guides is that, given the newness of the process to the Standing Parties, marking is not obligatory. Such abstentions will be managed by calculating the mean score by dividing the total marks by the number of respondents.


Supporting information and how it can be used:

So far, for each applicant, you have been provided with PDF extracts of the initial application response submissions as separate PDF's in each ANO candidate's respective thread -- one PDF for the subjective responses being assessed by the Standing Parties, and one PDF for the technical responses being assessed by the Guides.


Included in this post are two important Google sheets for your reference:

One for all Standing Parties with the subjective questions: https://docs.google.com/spreadsheets/d/1yuMTwe4oVWL4BrcLD6OuTDKY0HxDvjH2DfeqQ-ySbXU/edit?usp=sharing

One for the Guides and Testnet Admin with the technical questions: https://docs.google.com/spreadsheets/d/1aJjMSmvSYBi55VjLhqAYeZo3N6SHwu29qHmBHMQLRtQ/edit?usp=sharing

These Google sheets provide composite information with all applicant original data included; they are valuable because they enable relatively quick comparisons across candidates.

** The Standing Parties plus Guides and Testnet Admin will be required to make a private copy of these Google sheets (linked above) prior to use.**



Method of scoring

The method of voting/scoring on the subjective aspects is for the Standing Parties to enter the subjective score into the Factomize poll for each ANO applicant. Please see this example: https://factomize.com/forums/threads/scoring-test.1776/

The method of voting/scoring on the technical aspects is for the Guides to enter the technical score directly into the the data section of the scoring spreadsheet. -- Thus, this section will be performed directly within the scoring spreadsheet and -not- listed in a publicly viewable poll. However, after the scoring has concluded, and results announced, the scoring spreadsheet which shows how the Guides scored will be made public and transparently viewable.


Analysis and publication of results


Once the scores are submitted and the scoring deadline passed the Guides will be consolidating the scoring information in order to make a decision on which applicants have been successful.


Summary of actions required -- [PLEASE READ BELOW]

For providing the Subjective Scores, the Standing Parties (ANOs and Guides) should:

1 Make a copy of THIS spreadsheet https://docs.google.com/spreadsheets/d/1yuMTwe4oVWL4BrcLD6OuTDKY0HxDvjH2DfeqQ-ySbXU/edit?usp=sharing
2 Thoroughly read the individual applicant pdf extracts (which detail each ANO candidate’s application responses), the Q+A threads, and any separate attachments provided in the Factomize posts, together with the composite information and guidance in the above spreadsheet.
3 Score every applicant according to the spreadsheet.
4 Produce a score between 0-60 for every applicant.
5 Submit these scores in the polls in the individual ANO scoring-threads on Factomize which are linked to in the spreadsheet.
6 All scores must be submitted prior to 2019-05-26 23:59 UTC.



For providing the Technical Scores, the Guides should:

1 Make a copy of THIS spreadsheet
https://docs.google.com/spreadsheets/d/1aJjMSmvSYBi55VjLhqAYeZo3N6SHwu29qHmBHMQLRtQ/edit?usp=sharing
2 Thoroughly read the individual applicant pdf extracts (which detail each ANO candidate’s application responses), the Q+A threads, and any separate attachments provided in the Factomize posts, together with the composite information and guidance in the above spreadsheet.
3 Score every applicant according to the spreadsheet.
4 Produce a score between 0-40 for every applicant.
5 Submit these scores to this Google spreadsheet https://docs.google.com/spreadsheets/d/17v9UaYev3WFzmSQCe0Za4FnH-Oq-A4rso3kD5MZVG1o/edit?usp=sharing on the Guides Google Drive.
6 All scores must be submitted prior to 2019-05-26 23:59 UTC.


We hope that this is clear and invite all standing parties to ask any questions or seek support during this new process, during which time this thread will remain open.
 
Top