Frequently asked questions
What is BIGwiki?
BIGwiki is a comprehensive online platform dedicated to all things Web3 gaming-related. It acts as an information hub, research portal, and community space for anyone interested in exploring and understanding the evolving world of Web3 games. Whether you're a gamer, developer, creator, investor, or simply curious about the potential of Web3, BIGwiki provides valuable resources and insights into the Web3 gaming landscape.
How does BIGwiki evaluate the quality of Web3 games?
BIGwiki utilizes a multi-faceted approach to assess the quality of Web3 games. This includes a robust research process involving a team of experts and an AI-powered research agent, BIGmomma, driven by large language models. The evaluation process incorporates seven distinct criteria, or sections, with each section further categorized into subsections. Each subsection is assessed based on specific research questions. Scores are then calculated at both the individual user level and the population level, incorporating the contributions of multiple users to provide a comprehensive assessment of the game's "goodness".
What is the role of AI in BIGwiki's research process?
BIGwiki employs a sophisticated AI system, currently utilizing large language models like ChatGPT 4.0 and ChatGPT 4.0 mini. The system is LLM agnostic, meaning BIGwiki is open to exploring and integrating various AI models as technology advances. This system powers the research agent BIGmomma, who analyzes data and provides insights akin to a human user's opinion.
How does BIGwiki ensure the quality of its research?
BIGwiki maintains high research quality through several measures:
- CRAAP Test: All web-based sources are vetted using the CRAAP Test, ensuring Currency, Relevance, Authority, Accuracy, and Purpose. Only approved sources are used for research.
- Human Moderation: A team of experts moderates BIGmomma's output and user-uploaded content, ensuring accuracy and consistency. This includes identifying and addressing "hotspots" in the research prone to errors or inconsistencies.
- Community Input: Users can contribute their research, comments, and opinions, enriching the overall assessment and providing diverse perspectives.
What is the "CRAAP Test" and how is it used?
BIGmomma analyzes various data sources, including whitepapers, reviews, articles, and social media posts. BIGwiki employs the "CRAAP Test" to ensure the quality and reliability of these sources. Developed by librarians at California State University, the CRAAP Test is a method for evaluating the credibility of sources based on five key criteria:
- Currency: Is the information up-to-date?
- Relevance: Is the information applicable to the topic at hand?
- Authority: Is the source of the information trustworthy and knowledgeable?
- Accuracy: Is the information supported by evidence and free from errors?
- Purpose: What is the intent of the information, and is it biased or objective?
What are the principles behind BIGwiki's scoring system?
BIGwiki's scoring system utilizes a combination of user-derived scores and a weighted system for different sections and subsections. This system assigns weightings based on the relative importance of each subsection to the overall assessment of a game's "goodness." The scores are then aggregated to generate an overall game score, providing a comprehensive quantitative evaluation. To enhance user understanding, BIGwiki also employs a user-friendly traffic light system that visually represents the different aspects of a game using a qualitative five-category Likert scale.
How can users contribute to BIGwiki's research?
BIGwiki encourages active community involvement in the research process. Users can contribute to the research in several ways:
- Subsection-Level Comments: Users can engage in discussions by adding comments to other user’s research at the subsection level. Users can contribute their insights, opinions, and critiques, with BIG’s Ai-system then incorporating these contributions into the subsection level summaries.
- User-Uploaded Research: Users can contribute their detailed research on specific subsections, sections, or even entire games, earning $BIGGIE rewards for their efforts. This crowdsourced approach encourages community involvement and fosters diverse perspectives.
- Feedback and Suggestions: BIGwiki encourages users to provide feedback and suggestions to continually improve the platform and its research process.
What is the "Population of Opinions"?
The "Population of Opinions" refers to the collective views and assessments of all users on BIGwiki. User-submitted research, comments, and opinions all contribute to the Population of Opinions, allowing for a diverse range of perspectives on each game. This data is used to generate summaries at the subsection, section, and game level, representing the consensus view of the BIGwiki community.
What are "hotspots" in the research, and how are they addressed?
Hotspots are specific areas within the research that are identified as potentially containing errors, inconsistencies, or hallucinations generated by the AI. Moderators prioritize these areas for careful review. Depending on the nature of the issue, corrections are made directly, or BIGwiki comments are added to provide clarifications, explanations, or alternative viewpoints.
What is the role of human moderators in the research process?
Human moderators play a crucial role in ensuring the accuracy and integrity of the research produced by BIGmomma. They fact-check data, identify and address potential errors or inconsistencies, and provide additional context or insights where necessary. Their involvement ensures a balance between the efficiency of AI and the critical thinking and domain expertise of human researchers.
How does BIGwiki handle missing data in its evaluations?
BIGwiki recognizes that missing data can impact the accuracy of its evaluations. When missing data is identified, either by the team or community members, the team first attempts to locate reliable sources that address the missing information. If a suitable source is found, the AI is re-run with the new data. If no reliable source is available, moderators add comments, warnings, or explainers to acknowledge the gap in information and its potential implications.
How does BIGwiki ensure transparency and traceability of its research?
BIGwiki is committed to transparency and traceability in its research process. A comprehensive bibliography listing all sources used by BIGmomma is provided. Additionally, a referencing and internal navigation system (RINS) is being developed to allow users to easily locate and verify the source data underlying the research findings. Moreover, the entire nature of the BIGwiki approach is “openness and transparency”, right down to the detail of the sources and precise methodology used in their evaluations.
How can users navigate the research on site and access the original data sources?
BIGwiki employs a Referencing and Internal Navigation System (RINS) based on academic referencing principles. This system will allow users to navigate to specific sections and subsections, and even individual user comments. It also enables users to locate the original source data used in BIGmomma's and other user's research. A full bibliography listing all sources is provided. Note that RINS is still under development but should be fully functional in upcoming interactions of the site.
