中国国菜是什么菜| 肤色暗黄适合穿什么颜色的衣服| 私生粉是什么意思| 泥鳅吃什么食物| 什么的面目| 腰间盘突出压迫神经腿疼吃什么药| 白色情人节什么意思| 漂亮的近义词是什么| 更年期失眠吃什么药效果好| 石骨症是什么病| 喜欢蓝色的女人是什么性格| 干眼症用什么药最好| 甜瓜不能和什么一起吃| 眼睛干涩用什么眼药水| 情劫什么意思| 什么食物含镁| 安宫牛黄丸什么时候吃| 吃东西容易呛到是什么原因| 小腿酸胀吃什么药| 什么颜色的包包招财并聚财| 散瞳后需要注意什么| 亚甲炎吃什么药效果好| 鱼眼睛吃了有什么好处| 蜘蛛吃什么| 1898年属什么生肖| 人为什么会脱发| 八卦分别代表什么| 狐臭用什么药最好| 黄瓜有什么营养价值| 手机的英文是什么| 掉头发缺少什么维生素| 平滑肌是什么| 鸡为什么喜欢吃泡沫| 蜜蜡什么样的成色最好| 高回声是什么意思| 脖子皮肤黑是什么原因| 疣是什么样子图片| ca199偏高是什么意思| 夜游神是什么意思| 手术后放疗起什么作用| 求嗣是什么意思| 女生的小鸡鸡长什么样| 海棠花长什么样| 2009年是什么生肖年| 11月20日什么星座| 和珅属什么生肖| 个性化是什么意思| 屁股长痘痘是什么原因| 肠道紊乱有什么症状| 青梅是什么水果| 神经衰弱有什么症状| 初中学历能做什么工作| 耐信是什么药| 夜尿多什么原因| 尿路感染看什么科室| 右耳朵疼是什么原因| 孩子脾胃虚弱吃什么药| 猫上门为什么不能赶走| 嗓子疼吃什么水果好得快| 火星是什么意思| 月经期间吃什么水果好| 小孩积食吃什么药| 更年期是什么时候| 9月21号是什么星座| 阴虱长什么样子| 前位子宫是什么意思| 白天嗜睡是什么原因| 名什么古什么| sga是什么意思| 巨蟹座女和什么座最配| 五大发展理念是什么| 白蚁吃什么| 什么是聚酯纤维| 肝经不通吃什么中成药| 女性为什么会感染hpv| 1989年属什么的| 01年是什么年| 蚩尤是什么| 懋是什么意思| 什么是商k| 尿液中有泡沫是什么原因| 高血压不能吃什么水果| 撸铁是什么意思| 美女是什么生肖| 前纵韧带钙化是什么意思| 面基是什么意思| 起水痘不能吃什么食物| 莲藕不能和什么一起吃| 备孕要注意些什么| 168红包代表什么意思| 座驾是什么意思| 手上起倒刺是缺什么| 十二月四号是什么星座| 传媒公司主要做什么| 三月六号是什么星座| 梦见走亲戚是什么意思| tips是什么意思| 阴道出血是什么原因引起的| 耳朵里面疼用什么药| 肺结节什么东西不能吃| paco2是什么意思| 幼对什么| 肉字是什么结构| 甘薯是什么| gm是什么单位| 可可和咖啡有什么区别| 为什么说秦始皇还活着| 手不释卷的释是什么意思| 石斛长什么样子图片| 火险痣是什么意思| 早搏什么症状| 肌酐高有什么症状表现| 小猫发烧有什么症状| 鱼泡是什么| sub是什么意思| 日的偏旁有什么字| 细菌感染吃什么抗生素| 黄昏是什么时辰| 血糖高吃什么食物好| 便血挂什么科室| 成人发烧吃什么退烧药| 6月23日是什么节日| 意见是什么意思| 疱疹用什么药好得快| 阴道口出血是什么原因| 美国的国宝是什么动物| 溏是什么意思| 钢琴八级是什么水平| 早上6点半是什么时辰| 麻酱是什么做的| 妲是什么意思| 什么是竖式计算| 健康证需要什么| 五鬼是什么意思| 国际章是什么意思| 梦见陌生人死了是什么意思| 什么叫化学| 半夜醒来口干舌燥是什么原因| 右后背疼是什么病| 团长转业到地方是什么职务| 什么食物是养肝的| 低血糖是什么症状| 右乳导管扩张什么意思| 胎儿偏小是什么原因| 1946年属什么| 1m是什么意思| 准妈妈是什么意思| 结婚32年是什么婚| 胃疼吃什么食物对胃好| 摩羯男喜欢什么类型的女生| 什么的感受| 什么颜色的猫最旺财| amber是什么意思| 七五年属什么生肖| 甲钴胺是什么| 非什么意思| 耳鬓厮磨是什么意思| 干咳吃什么药效果好| 印度神油是什么东西| 一什么篮子| 山梨糖醇是什么| 鱿鱼不能和什么一起吃| 吃什么能排毒体内毒素| rock什么意思| 铁罗汉是什么茶| 血浆蛋白是什么| mpa是什么意思| 经常跑步对身体有什么好处| 陈皮有什么好处| 婴儿便秘怎么办什么方法最有效| 吊兰开花有什么兆头| 肉桂跟桂皮有什么区别| 丁火是什么意思| 象是什么结构的字| 天空为什么是蓝色的| 万言万当不如一默是什么意思| 骨质增生吃什么药效果好| 胃酸过多吃什么药| 贡菊泡水喝有什么功效| 士官是什么| 幼儿园什么时候放暑假| 拉抽屉是什么现象| 嘴唇是紫色的是什么原因| 总胆红素偏高是什么原因| 什么贵人能治孤辰寡宿| 初恋什么意思| 毛泽东属相是什么| 黑曜石适合什么人戴| 什么什么分明的成语| fe是什么元素| 不丹为什么不跟中国建交| 授记是什么意思| 甲状腺功能是什么| 绿豆和什么一起煮好| 白带豆腐渣状用什么药| 人参片泡水喝有什么功效和作用| 孩子打呼噜是什么原因| 水泥烧伤皮肤用什么药| 珑骧包属于什么档次| 猫三联什么时候打| 月黑见渔灯的见读什么| 入定是什么意思| 为什么一喝牛奶就拉肚子| 女人梦到被蛇咬是什么意思| 衣原体阳性是什么病| 保险属于什么行业| 胎菊和金银花一起泡水有什么效果| 地板油是什么意思| 剁椒鱼头是什么鱼| 榴莲什么样的好吃| 女人喝什么茶叶最好| 看胃挂什么科室| 麝香什么味道| 什么血型不招蚊子| 梦见长牙齿预示着什么| 做绝育手术对女人有什么影响| 流清鼻涕是什么原因| 慢慢地什么填词语| 为什么姓张的不用说免贵| 军区司令是什么级别| 平舌音是什么| 晚上经常做梦是什么原因| 空调开不了机是什么原因| 最小的动物是什么| 白细胞偏低有什么症状| 四肢麻木是什么原因引起的| 胃反流是什么原因引起的| 单侧流鼻血是什么原因| 田亮为什么不娶郭晶晶| 三十六计第一计是什么计| 一六年属什么生肖| 藏族信仰什么教| 洪七公什么生肖| 孕妇可以喝什么汤| xxoo什么意思| 海蓝之谜适合什么年龄| 胆固醇高是什么病| 篱笆是什么意思| 甲状腺功能亢进症是什么病| 奥美拉唑是治什么病的| 家里消毒杀菌用什么好| 中央委员是什么级别| 农历五月初五是什么节| 1947属什么生肖| 针眼长什么样| 细小是什么病什么症状| 发烧酒精擦什么部位| 钺读什么| cim是什么意思| 便秘什么原因引起的| 薄熙来犯了什么罪| 脂肪肝什么症状| 化险为夷的夷什么意思| 四个火是什么字| 人的舌头有什么作用| 柴米油盐什么意思| 吃什么祛痰化痰最有效| 风湿性心脏病是什么原因引起的| 什么因果才会有双胞胎| 肾b超能检查出什么| 失眠挂什么科| 楚门的世界是什么意思| 脸颊两边长痘痘是什么原因引起的| 莫须有什么意思| 百度Jump to content

车未到站乘客要下车被拒 两脚踹垮车门跳下车去

From mediawiki.org
Newcomer tasks at Czech Wikipedia
百度 2017年8月17日18时31分,中石油大连石化公司第二联合车间140万吨/年重油催化裂化装置泄漏并引发火灾。

This page describes the Growth team's work on the "newcomer tasks" project, which is a specific project under the larger "Personalized first day" initiative. This page contains major assets, designs, and decisions. Most incremental updates on progress will be posted on the general Growth team updates page, with some large or detailed updates posted here.

You can quickly see what the team built by looking through these mockups (use arrow keys to navigate):

The design and planning for this project began on 2025-08-06. The first version was deployed in four wikis on 2025-08-06.

In December 2020, we published results showing the positive impact that newcomer tasks have on engagement. See this page for the details.


Current status

[edit]
  • 2025-08-06: first team meeting to discuss newcomer tasks
  • 2025-08-06: team meeting to go over design concepts.
  • 2025-08-06: Phabricator tasks created for engineering work
  • 2025-08-06: desktop user tests complete
  • 2025-08-06: mobile user tests complete
  • 2025-08-06: V1.0 deployed to Czech, Korean, Arabic, and Vietnamese Wikipedias
  • 2025-08-06: first variant test ("initiation") deployed to Czech, Korean, Arabic, and Vietnamese Wikipedias
  • 2025-08-06: testing the addition of topic matching, to be deployed the week of 2025-08-06.
  • 2025-08-06: the option to select topics of interest was added to the suggested edits module
  • 2025-08-06: topic matching upgraded to use ORES models
  • 2025-08-06: results from first variant test
  • 2025-08-06: switched all newcomers to Variant A
  • 2025-08-06: deployed guidance
  • 2025-08-06: deployed Variants C and D
  • 2025-08-06: Published Newcomer tasks experiment analysis
  • Next: Continue improvements to Newcomer tasks and possibly develop new Structured tasks

Summary

[edit]
Difficulty filters for newcomers tasks.

We think that newcomers should have every opportunity to succeed when they first arrive at the wiki. But frequently, newcomers attempt a task that is too difficult for them, can't find a task they want to do, or can't find ideas for how to remain involved after their first edit. This leads to many of them leaving and not coming back. There have been successful attempts in the past at recommending tasks to editors, and so we believe that the newcomer homepage is a potential place to recommend relevant tasks for newcomers.

We'll need to keep in mind a few things:

  • Many newcomers arrive with something specific in mind they're trying to accomplish, like add a specific photo to a certain article. We don't want to get in the way of them accomplishing their goal.
  • Newcomers build up their skills over time by progressing from easier edits to hard ones.
  • When newcomers are successful early on, they are more motivated to continue editing.

Taking those things into account, we want to recommend tasks to newcomers that arrive at the right place and time for them, teach them skills they need to be successful, and relate to their interests.

A valuable tool we have for helping tasks be relevant to newcomers is the welcome survey, which was originally built specifically for this purpose: personalizing the newcomer's experience. We'll plan to use the optional information newcomers give about their goals and interests to recommend appropriate tasks for them.

One of the largest challenges is going to be figuring out how to gather tasks that are appropriate for newcomers to do. There are many existing sources, such as templates that call for work on articles, recommendations in the Content Translation tool, or suggestions from tools like Citation Hunt. The question will be which of those options help newcomers accomplish their goals.

At first, we'll focus on using the newcomer homepage as the place to recommend tasks, but in the longer term, we can imagine building features that extend into the editing experience to recommend and help newcomers accomplish recommended tasks.

Also in the longer term, we'll be thinking about ways to tie task recommendations into other parts of the newcomer experience, such as the impact module on the homepage, or into the help panel.

Why this idea is prioritized

[edit]

We know from research and experience that many newcomers fail early in their editing journey for one of these reasons:

  • They arrive with a very challenging edit in mind, such as writing a new article or adding an image. Those tasks are difficult enough that they likely fail and don't return.
  • They arrive without knowing what to edit, and can't find any edits to make.

We also know that on the newcomer homepage, the most frequently clicked-on module is the "user page" module -- the only thing on the page that encourages users to start editing. This makes us think that many users are looking for a clear way to get started with editing.

And from past Wikimedia endeavors, we've seen that task recommendations can be valuable. SuggestBot is a project that sends personalized recommendations to experienced users, and is a well-received service. The Content Translation tool also serves personalized recommendations based on past translations, and has been shown to increase the volume of editing.

For all these reasons, we think that recommending specific editing tasks for newcomers will give them a clear way to get started. For those newcomers that have an edit in mind that we want to do, we'll encourage them to try some easy edits first to build up their skills. For those newcomers who do not have a specific preference on what to edit, they'll hopefully find some good edits from this feature.

Glossary

[edit]

There are many terms that sound similar and can be confusing. This section defines each of them.

"Newcomer tasks"
The entire workflow that recommends edits for newcomers and guides them through the edits.
"Suggested edits"
The name of the specific module that the newcomer tasks workflow adds to the newcomer homepage.
"Task recommendations" or "Task suggestions"
Lists of articles that need editing work, suggested automatically to users.
"Personalized"
Software that adapts automatically to each user to fit their needs.
"Customized"
Software that the user adapts to fit their needs.
"Topic"
A content subject, such as "Art", "Music", or "Economics".
"Topic matching"
The ability to find tasks for newcomers that match their topics of interest.
"Guidance"
Features that help the newcomer complete the suggested task while they are working on it.
"Maintenance template"
Templates that are put on articles indicating that work needs to be done on them.

Recommending tasks

[edit]

The core challenge to this project is: Where will the tasks come from and how will we give the right ones to the right newcomers?

The graphic below shows our priorities when recommending tasks to newcomers.

As shown in the graphic above, we would give newcomers tasks that...

  • ...arrive at the right time and place for a newcomer's journey.
  • ...teach relevant conceptual and technical skills.
  • ...gradually guide users to build up their editing abilities.
  • ...be personalized to their interests.
  • ...show them the value and impact of editing.
  • ...motivate them to participate continually.

For instance, we do not want to give newcomers tasks that are irrelevant to what they hope to accomplish. If a newcomer wants to write a new article, then asking them to add a title description will not teach them skills they need to be successful.

We're splitting this challenge into two parts: the sourcing the tasks and topic matching.

Sourcing the tasks

[edit]

There are many different places we could find tasks for newcomers to do. Our team listed as many as we could think of and evaluated them for whether they seem to be achievable for the first version of the feature. Below is a table showing the many sources of tasks that we evaluated in coming to the decision to start by using maintenance templates.

Source of task Explanation Evaluation
Maintenance templates Most wikis use templates or categories to indicate articles that need copyediting, references, or other modifications. These are placed manually by experienced users. Easily accessible. Already used in SuggestBot and GettingStarted .
Work on newest articles New articles may be good candidates for work because they likely could be improved or expanded. They are also more likely to be about current topics. Easily accessible, but most new articles are created by experienced users, and may not need help from newcomers.
Add images from Commons There are articles that have images in some language Wikipedias but not in others. This could be a good task for a newcomer who created their account in order to add an image of their own. An idea with high potential, but would require a lot of work to build interfaces. There are also questions about how to identify whether an article needs an image, and which one to recommend.
Expand short articles Many articles are stubs that could be expanded. This task is probably too open-ended and difficult for a newcomer.
Link to orphan articles Many articles have no incoming links from any other articles. Users could find articles to link to the orphan articles. Easy to identify orphans, but may be confusing for a newcomer to have to go find other articles in order to do the task.
Add references Many articles are in need of additional references or citations. Probably a challenging task for a newcomer. Frequently covered by maintenance templates.
Add categories Categories are used for many purposes on the wikis, and adding them to articles that don't have them could be a low-pressure way to contribute. Newcomers may not have good judgment when it comes to adding categories. This also does not teach editing skills that they need for other tasks.
Content translation The Content Translation tool could be a good way to structure the editing experience and help newcomers write new articles without having to generate all the content on their own. An integration here could be great -- we may want to use the welcome survey to distinguish which newcomers are multilingual.
Add sections There are algorithms in development that can recommend additional section headers based on similar articles. Writing a new section from scratch may be too challenging a task for a newcomer.
Specific link recommendation Adding wikilinks is one of the best tasks for newcomers. It would be powerful if we could not only tell a newcomer that an article needs more links, but indicate which specific words or phrases should become an link (internal and/or external, depending on local policies). Some research has been done on this idea that the team will be looking into, as this idea could be a perfect first edit for a newcomer.
Copy editing Many articles need copyediting, but it would be a better experience for newcomers if we could suggest specific changes to make in article, such as words that are likely misspelled or sentences that likely need to be rephrased. While this would be an excellent experience for the newcomer, we don't have a way to approach this. Perhaps experienced could flag specific copy edit changes instead of fixing them.
External link cleanup Help ensure articles follow external link policies. Could be populated by the external links cleanup maintenance category.
Neutral point of view Offer people suggestions for how they can "neutralize" subjective text (T376213) Previous research indicates that algorithms could be used to recommend edits that enhance the neutrality of articles.

Version 1.0: basic workflow

[edit]

In version 1.0, we will deploy the basic parts of the newcomer tasks workflow. It will recommend articles to newcomers that require different types of edits, but it will not match the articles to the newcomers' topics of interest (version 1.1), and it will also not guide the newcomers in completing the task (version 1.2).

Maintenance templates

[edit]

We're going to be starting by using maintenance templates and categories to identify articles that need work. All of our target wikis use some set of maintenance templates or categories on thousands of articles, tagging them as needing copyediting, references, images, links, or expanded sections. And previous task recommendations software, such as SuggestBot, have used them successfully. These are some examples of maintenance categories:

Example of maintenance template on English Wikipedia

In this Phabricator task, we investigated exactly which templates are present and in what quantities, to get a sense of whether there will be enough tasks for newcomers. There seem to be sufficient numbers for the initial version of this project. We are likely to incorporate other task sources from the table below in future versions.

It's also worth noting that it could be possible to supplement many of these maintenance templates with automation. For instance, it is possible to automatically identify articles that have no internal links, or articles that have no references. This is an area for future exploration.

During the week of October 21, 2019, the members of the Growth team did a hands-on exercise in which we attempted to edit articles with maintenance templates. This helped us understand what challenges we can expect newcomers to face, and gave us ideas for addressing them. Our notes and ideas are published here.

Design

[edit]

Comparative review

[edit]

Our team's designer reviewed the way that other platforms (e.g. TripAdvisor, Foursquare, Amazon Mechanical Turk, Google Crowdsource, Reddit) offer task recommendations to newcomers. We also reviewed Wikimedia projects that incorporate task recommendations, such as the Wikipedia Android app and SuggestBot. We think there are best practices we can learn from other software, especially when we see the same patterns across many different types of software. Even as we incorporate ideas from other software, we will still make sure to preserve Wikipedia's unique values of openness, clarity, and transparency. The main takeaways are below, and the full set of takeaways is on this page:

  • Task types – bucket into 4 types: Rating content, Creating content, Moderating/Verifying content, Translating content
  • Incentives – Most products offered intangible incentives mainly bucketed into the form of: Awards and ranking (badges), Personal pride and gratification (stats), or Unlocking features (access rights)
  • Reward incentives – promote badges or attainments of specific milestones (e.g., a badge for adding 50 citations)
  • Personalization/Customization – Most have at least one facet of personalization/customization. Most common customization is user input on surveys upon account creation or before a task, most common system-based personalization type is geolocalization
  • Visual design & layout – incentivizing features (stats, leaderboards, etc) and onboarding is visually rich compared to pared back, simple forms to complete short edits.
  • Guidance – Almost all products reviewed had at least basic guidance prior to task completion, most commonly introductory ‘tours’. In-context help was also provided in the form of instructional copy, tooltips, step-by-step flows,  as well as offering feedback mechanisms (ask questions, submit feedback)

Mockups

[edit]

Our evolving designs can always be found in two sets of interactive mockups (use arrow keys to navigate):

Those mockups contain explorations of all the difference parts of the user journey, which we have broken down into several parts:

  1. Gathering information from the newcomer: learning what we need in order to recommend relevant tasks.
  2. Feature discovery: the way the newcomer first encounters task recommendations.
  3. Task recommendations: the interface for filtering and choosing tasks.
  4. Guidance during editing: once the newcomer is doing a task, the guidance that helps them understand what to do.
  5. User feedback: ways in which the newcomer can indicate that they are not satisfied with the recommended task.
  6. Next edit: how we continue the user's momentum after the save an edit.

Below are some of the original draft design concepts as the team continues to refine our approach.

User testing

[edit]

Desktop

[edit]

During the week of September 16, 2019, we used usertesting.com to conduct six tests of the desktop newcomer tasks prototype with internet users unaffiliated with the Wikimedia movement. In these tests, respondents are compensated for trying out the mockups, speaking aloud on what they observe, and answering questions about the experience. The full results can be found in this Phabricator task. The goals of this testing were:

  1. Gauge the discoverability  of the newcomer tasks module
  2. Identify improvements to the usability of the tasks module:
    1. Do users understand how to select and review article suggestions?
    2. Do users understand how to filter by interests and task difficulty?
    3. Do they know how to start editing a suggested article?
  3. Gauge user reactions to the suggestions and expectations about guidance through the task.
Summary of findings
  • All users thought it made sense and intuitive to get suggestions based on their topics of interest.
  • Similarly, the different task difficulties was positively received by all participants.
  • Overall usability of the suggested edits module was extremely high. People knew how to click to view more articles, use the filter to change topics and task levels, and knew to click on the card to open a suggestion for editing.
  • 4/6 Participants did not initially realize that they should click on “See suggested edits” as a way to help them achieve their goal of writing a new article. This seemed to be a common mental model where users separated "Editing" as different from "Creating a new page".
  • Start module is clearly the starting point for all participants. Moreover many were drawn to “See suggested edits” button as a way to follow the progression of activities in the start module.
  • Users had a clear understanding and expectation they would be shown suggested articles for editing based on the intro dialogs to add topics and introducing task levels.
  • Everyone was able to select the popular topics and add their own topic easily.
  • Everyone understood the purpose of the suggested edits module.
  • Two people were confused/assumed that they could not create a new article until completing easy and medium tasks.
  • 5 of 6 participants knew to click on the help panel button for guidance once they entered the editor mode.
  • Four people expected to be able to contact their mentor in the help panel.
  • Task tips lacked sufficient level of guidance for a couple of participants.
Recommendations
  • Improve copy and more over user education that creating new content is a form of editing.
  • Make updates to the Impact module as tested here to aid user understanding of suggested edits.
  • Provide good in-edit context help. It’s very important for users trying an edit.
    • Include a “checklist” for users to revise in the help panel’s task tips.
    • Provide short examples of what to do.
    • Indicate to users they do not have to copy edit for an entire article.
  • Including real-time filtering results helps users connect suggestions as article edits and encourage use of the filtering to find matching articles.

Mobile

[edit]

During the week of September 30, 2019, we used usertesting.com to conduct six tests of the mobile newcomer tasks prototype. The full results can be found in this Phabricator task. The goals of this testing were the same as with desktop, but with the added goal of understanding how the mobile experience should differ from the desktop experience. Mobile user testers were prompted with the scenario of intending to add an image to Wikipedia (whereas desktop respondents were prompted with the scenario of intending to create a new article).

Summary of findings

  • Overall users found the start module (redesigned) clearly laid out the guided steps to begin.
  • The extra “Suggested edits” module below, while not especially confusing, was still not where users expected to go to help them with their task to add an image.
  • Suggested edits was quite intuitive to use, with participants understanding how its different elements (filtering, seeing more articles, etc) worked.  However, users do not see the value of doing Suggested edits beyond learning or boredom.
  • Several people wanted more granular topics to be available than the broad topics listed.
  • Having the detailed difficulty info was educational, but potentially discouraging. All were surprised “Adding images” was classed as hard, with varying degrees of frustration about this fact.
  • Filtering by interests is a big selling point.
  • 3 people towards the end of the test assumed there was some “verification” or requirement to do  some Easy tasks before Medium/Hard tasks could be achieved
  • Everyone understood the purpose of the Suggested edits as giving edits that would users learn to edit, and also emphasize that it showed them some edits were harder to do.
  • All users struggled to use the guidance we offered through the help panel while they were editing. This is a major area we need to think hard about designing before we begin to build it.

Recommendations

  • Suggested edits call to action is inside start module, not its own card.
  • Improve copy and user education imagery to better convey that there is real world value in trying suggested edits beyond learning and that task difficulty is a guide only and tasks can be tried out of order.
  • Add an overlay specifically to introduce personalized introduction to suggested edits.
  • Including real-time counting of filtered results on both task and topic filters.
  • Incorporate more granular searching by interest topics by users.
  • Reiterate when a user opens a suggestion that it is a real, impactful edit.
  • Update design of the in-task help panel so that all available help content is clearly accessible.

Version 1.1: topic matching

[edit]

Past research and development shows that users are more likely to do recommended tasks if the tasks match their topical interests. SuggestBot uses an editor's past editing history to find similar articles, and those intelligent results are shown in this paper to be executed on more often than random results. The Content Translation tool also recommends articles based on a user's previous translation history, and those recommendations have increased the translation volume.

In looking at the usage of V1.0 of newcomer tasks, which does not contain topic matching, we see that there are users who navigate through many suggested articles, and end up clicking on none. There are also users who navigate through many, and end up editing only the ones they happen to find that belong to a certain topic, such as medicine. These are also good indicators that topics can be valuable to help newcomers find articles they want to edit.

Our challenge with newcomers is a "cold start problem", in that newcomers do not have any edit history to use when trying to find relevant articles for them to edit. We want to have an algorithm that says what the topic is of each article, and use that to filter the articles that have maintenance templates.

Algorithms

[edit]
Screenshot of ORES topic selection filter on desktop

There are multiple approaches with which we might find articles that match a user's stated topic of interest. While our team identified many, we built prototypes for three methods and tested them:

  • morelike: assign a seed list of articles that represent each topic area (e.g. "Art" might be represented by the articles for "Painting", "Sculpture", "Dance", and "Weaving".) Use that seed list to find other articles that are similar to those in the seed list by using a similarity algorithm called "morelike".
  • free text: instead of choosing from a set list of topics, allow newcomers to type in any phrase they want to indicate a topic. Use regular Wikipedia search to surface articles relevant to that phrase.
  • ORES: ORES is a machine learning service that – among other things – can return a predicted topic for any article. Though this prediction service only works in English Wikipedia, there are ways to translate predictions from English to other wikis.

In this Phabricator task, we evaluated the three methods, and decided to proceed with the ORES model. The Growth team worked with the Scoring team to strengthen the model, and with the Search team to make the model predictions available to the newcomer tasks workflow. During the time that this work was happening, we deployed the somewhat worse-performing morelike algorithm, and switched to the ORES model about a month later.

The ORES model we use now offers 64 topics, and we chose to expose 39 of them to newcomers. The evaluation in four different languages showed that on average, 8.5 out of 10 suggestions for a given topic seem like good matches for that topic.

Design

[edit]

In designing interfaces that allow newcomers to choose topics of interest, these are some of the considerations:

  • How to make a long list of about 30 topics not overwhelming to the user?
  • How to handle multiple layers of topics (e.g. if "Science" has sub-topics of "Biology", "Chemistry", etc.)
  • Whether users can give feedback when a topic does not match what they selected?

These mockups contain our current designs for this interface. You can navigate with your keyboard's arrow keys. Below are some images of the mockups:

Version 1.2: guidance

[edit]

Guidance was deployed on 2025-08-06. For a guide to translating the messages in this feature, see this page.

After newcomers have selected an article from the suggested edits module, they should receive guidance about how to click edit and complete the edit successfully. While it is exciting that some portion of newcomers are completing suggested edits without guidance, we're confident that by adding guidance, we will substantially increase how many newcomers edit.

We decided to repurpose the help panel as the place to deliver this guidance. Reusing the help panel will allow us to build quickly. The guidance contains three phases:

  1. When the user has arrived on the article and before they click edit.
  2. After clicking edit and before saving an edit.
  3. After saving an edit.

Some of the ideas we considered implementing included:

  • Guidance tailored to each type of edit, varying depending on whether the suggested edit is a copyedit, adding links, adding references, etc.
  • Reminder that an edit can be small, and that the user does not have to edit the whole article.
  • Step-by-step walkthrough that is like a checklist for completing the edit.
  • Highlighting the maintenance templates in the article so that the user can see why the article was suggested.
  • An indicator that encourages the user to click the edit button.
  • A place to put videos that demonstrate how to complete the edit.
  • Suggestions for additional edits after saving the initial edit.
  • Ability for the user to notify their mentor that they have done an edit, so the mentor can check their work and thank them.

During the last week of December 2019, we user tested desktop and mobile prototypes, which can be found below. We will post the user test results after assembling them.

Below are some images of the prototype:

Variant testing

[edit]

After deploying the first version of newcomer tasks, we want to start testing different variants of the feature, so that we can improve it iteratively. Rather than just having one design of newcomer tasks, and seeing if newcomers are more productive with it than without it, we plan to test more than variant of newcomer tasks at a time, and compare them. We have compiled an exhaustive list of all the ideas of variants to test -- but we will only end up testing perhaps 10 per year, because of the effort and time it takes to build, test, and analyze.

In March, April, and May 2020, we'll be testing variants that aim to get more users into the newcomer tasks flow.

See this page for the list of variant tests and their results.

Measurement and results

[edit]

Controlled experiment

[edit]

In December 2020, we published the results of a controlled experiment showing that newcomer tasks have a positive impact on engagement. These are our most important results, and give us confidence that these features should expand to more wikis. See this page for the details.

Usage

[edit]

Starting in December 2019, we have been tracking several key metrics from newcomers tasks. The graphs shown in this section are our main charts of those metrics as of 2025-08-06.

Summary

[edit]

Since deploying newcomer tasks in November 2019, we have seen steady increases in both the number of edits from the feature and the number of editors using the feature. These increases are due to two elements: (a) improvements to the feature, and (b) expanding the feature to more wikis.

Specific charts

[edit]
Conversion funnel for newcomer tasks as of 2025-08-06

Conversion funnel: the first graph is the most important to our team. Each line shows how many newcomers arrive at each stage of our "conversion funnel", meaning how far they progress into the newcomer tasks workflow, as a percentage of newcomers who visit their homepage. We want the users to move through the stages of:

  1.   interacting with the module,
  2.   selecting an article,
  3.   clicking edit on the article,
  4.   saving an edit.

In general, we want to see all the lines go up.

  • Since the early days of the feature, the percentage of users who have clicked edit and who have saved edits have steadily gone up. In January 2020, something like 2% of newcomers who visited their homepage saved a suggested edit. In August 2020, that has grown to 5.3%, which is more than double.
  • In August, almost all users who selected a task clicked edit, which can be seen by the closeness of the red and orange lines.
  • We think that these improvements are due to the two major features we deployed between January and August: topic matching (which allows newcomers to find more interesting articles) and guidance (which encourages them to click edit and explains how to complete the edit).

Edits: the second graph shows the number of newcomer task edits completed each week, with a separate line for each wiki and a "total" line in black. From December to August 17, there have been 15,126 edits completed through newcomer tasks. It is clear that this has grown over time, which is certainly to be expected because we have gone from 4 wikis to 12 between January and August.

But looking at the individual wikis' lines, it is possible to see growth over time.

Number of edits from newcomer tasks as of 2025-08-06
  • It is common for the number of suggested edits completed each week on a wiki to vary a lot. One of the reasons is that a small number of enthusiastic newcomers can create dozens or hundreds of edits in a short time, but then may not be on wiki on other weeks.
  • Arabic Wikipedia, being one of the largest wikis that has the feature, consistently creates the most edits.

Editors: in addition to tracking the number of edits, we also want to make sure that increasing numbers of newcomers are participating. The third graph shows the number of users completing newcomer tasks each week, broken out by wiki.

Number of editors using newcomer tasks as of 2025-08-06
  • Similarly to the graph of edits, this number also has increased steadily, and the addition of new wikis (such as French Wikipedia on week 21 and Persian Wikipedia on week 32) are clearly visible.
  • We believe that the effect of "guidance" is visible. This was released before week 25. There have been over 100 users of newcomer tasks every week since its release, whereas only three weeks had previously reached that level.


Edit quality

[edit]

The Growth team's ambassadors have gone through over 300 edits saved by newcomers and marked whether or not each edit was productive (meaning that it improved the article). We are happy to see that about 75% of the edits are productive. This is similar to the baseline rate for newcomer edits, and we're glad that this feature has not encouraged vandalism. Most of the edits are copyedits, with many also adding links, and some even adding content and references. About a third of users who make one suggested edit go on to make additional suggested edits. Many also go on to make edits that are not suggested by the feature, which is behavior we are happy to see.

The high-quality edits we're seeing encourage us to improve the feature so that more newcomers begin and complete its workflow.

鼻炎是什么症状 像什么一样 后果的意思是什么 求知欲的欲什么意思 阁老是什么意思
从从容容的意思是什么 凤眼果什么时候成熟 拉血是什么原因 什么字寓意好 喝绿豆汤有什么好处
柿子叶有什么功效 意味深长是什么意思 什么叫介入治疗 oof是什么意思 凌寒独自开的凌是什么意思
头疼是为什么 12年义务教育什么时候开始 梦见青蛙是什么预兆 公租房是什么 什么是规培
干净的什么hcv9jop1ns0r.cn 什么茶叶降血压最好hcv9jop4ns1r.cn 11年属什么hcv9jop6ns0r.cn 长期吃泡面有什么危害hcv9jop4ns3r.cn 吃什么能生精和提高精子质量cl108k.com
乐捐是什么意思hcv9jop6ns3r.cn 野蒜有什么功效和作用hcv7jop9ns7r.cn 66年属马是什么命hcv8jop5ns8r.cn 胎芽是什么意思hcv9jop6ns1r.cn 什么原因造成痫性发作hcv9jop6ns9r.cn
胎盘位于子宫后壁是什么意思adwl56.com 四是什么生肖hcv7jop6ns1r.cn 什么球不能踢hcv8jop6ns1r.cn 什么叫丹凤眼hcv9jop7ns5r.cn 北斗星代表什么生肖liaochangning.com
不期而遇什么意思hcv9jop4ns4r.cn 小孩子坐飞机需要什么证件hcv7jop5ns2r.cn 哈吉是什么意思beikeqingting.com 射手座的幸运色是什么hcv9jop4ns8r.cn 奇的多音字是什么hcv7jop6ns1r.cn
百度