| 大赛简介 |
This task is to evaluate both the prediction accuracy and interpretability of the sentiment analysis models. Given a text, the model needs to provide the predicted sentiment label and the rationale that supports the current prediction. The model accuracy is evaluated on predicted labels, and the performance of interpretability is evaluated on provided rationales.
This task provides a fine-grained evaluation dataset with human-annotated rationales and perturbed examples, which can be used to evaluate interpretability from multiple perspectives. Please see the paper “A Fine-grained Interpretability Evaluation Benchmark for Neural NLP“ for the details of dataset construction. Besides, an example from this dataset is shown in “dataset” section, and the metrics are introduced in “metrics” section. We hope this dataset can facilitate the research progress of interpretability. |
| 参赛方式 |
参赛方式及规则 Entry Method and Rules（1） 所有参赛选手都必须在百度大脑AI Studio平台注册报名；
（2） 参赛选手需确保注册时提交信息准确有效，所有的比赛资格及奖金支付均以提交信息为准；
（3） 参赛选手报名后可在“我的团队”页面组队。每支队伍需指定一名队长，队伍成员总数最多不超过5人；注意：报名截止日期之后不允许更改队伍成员名单，请谨慎选择队员组队；
（4）队伍名的设定不得违反中国法律法规或社会公序良俗，且参赛队伍命名中不可出现“百度官方”，“飞桨官方”，“paddle官方”，“官方baseline”等字样。若命名违规的队伍在收到比赛主办方警告后仍未修改队伍名称，比赛主办方有权解散该队伍 ；
（5） 每名参赛选手只能参加一支队伍，一旦发现某选手以注册多个账号的方式参加多支队伍，将取消相关队伍的参赛资格；
（6）参赛队伍可在参赛期间随时上传测试集的预测结果，每个队伍每天仅有一次提交机会，请各队伍谨慎提交预测结果，比赛管理系统会实时更新当前最新榜单排名情况； （1）All contestants must register on the Baidu Brain AI Studio platform;
（2）All contestants must ensure that the information submitted during registration is accurate and valid. All eligibility and bonus payment is based on the information submitted;
（3）All contestants can form a team on the “My Team” page after registration. Each team must designate a team leader, and the total number of team members shall not exceed 5; Note: The list of team members is not allowed to be changed after the registration deadline. Please select each team member carefully;
（4）The names of the teams shall not be set in violation of Chinese laws and regulations or public order and good customs, and the names of the participating teams shall not be used as “Baidu Official”, “Paddle official”, “official baseline” or other words. If the offending team fails to change its name after receiving a warning from the competition organizer, the competition organizer has the right to dismiss the team;
（5） Each contestant can only join one team. Once a contestant is found to have joined more than one team by registering multiple accounts, the relevant team will be disqualified;
（6）The participating teams can upload the predicted results of the test set at any time during the competition. Each team has only one chance in one day to submit the predicted results. All teams are requested to submit the predicted results cautiously;
|
