Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
62 changes: 31 additions & 31 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,31 +1,31 @@
![logo_ironhack_blue 7](https://user-images.githubusercontent.com/23629340/40541063-a07a0a8a-601a-11e8-91b5-2f13e4e6b441.png)

# Natural Language Processing Challenge

## Introduction

Learning how to process text is a skill required for Data Scientists.
In this project, you will put these skills into practice to identify whether a news headline is real or fake news.

## Project Overview

In the file `dataset/training_data.csv` you will find dataset containing news headlines and their tags:
0, if the headline is fake news, and, 1, if the headline is real news.

Your goal is to build a classifier that is able to distinguish between the two.

Once you have a classifier built, then use it to predict the labels for `dataset/testing_data.csv`. Generate a new file
where the label `2` has been replaced by `0` (fake) or `1` (real) according to your model. Please respect the original file format,
do not include extra columns, and respect the column separator.


## Guidance
Like in a real life scenario, you are able to make your own choices and text treatment.
Use the techniques you have learned and the common packages to process this data and classify the text.

## Deliverables

1. **Python Code:** Provide well-documented Python code that conducts the analysis.
2. **Predictions:** A csv file in the same format as `testing_data.csv` but with the predicted labels (0 or 1)
3. **Accuracy estimation:** Provide the teacher with your estimation of how your model will perform.
4. **Presentation:** You will present your model in a 10-minute presentation. Your teacher will provide further instructions.
![logo_ironhack_blue 7](https://user-images.githubusercontent.com/23629340/40541063-a07a0a8a-601a-11e8-91b5-2f13e4e6b441.png)
# Natural Language Processing Challenge
## Introduction
Learning how to process text is a skill required for Data Scientists.
In this project, you will put these skills into practice to identify whether a news headline is real or fake news.
## Project Overview
In the file `dataset/training_data.csv` you will find dataset containing news headlines and their tags:
0, if the headline is fake news, and, 1, if the headline is real news.
Your goal is to build a classifier that is able to distinguish between the two.
Once you have a classifier built, then use it to predict the labels for `dataset/testing_data.csv`. Generate a new file
where the label `2` has been replaced by `0` (fake) or `1` (real) according to your model. Please respect the original file format,
do not include extra columns, and respect the column separator.
## Guidance
Like in a real life scenario, you are able to make your own choices and text treatment.
Use the techniques you have learned and the common packages to process this data and classify the text.
## Deliverables
1. **Python Code:** Provide well-documented Python code that conducts the analysis.
2. **Predictions:** A csv file in the same format as `testing_data.csv` but with the predicted labels (0 or 1)
3. **Accuracy estimation:** Provide the teacher with your estimation of how your model will perform.
4. **Presentation:** You will present your model in a 10-minute presentation. Your teacher will provide further instructions.
9,984 changes: 0 additions & 9,984 deletions dataset/testing_data.csv

This file was deleted.

34,152 changes: 0 additions & 34,152 deletions dataset/training_data.csv

This file was deleted.

1 change: 1 addition & 0 deletions finalNotebook_with_ELECTRA(1)(1).ipynb

Large diffs are not rendered by default.

9,984 changes: 9,984 additions & 0 deletions outputs_predictions_electra_correct_format(2).csv

Large diffs are not rendered by default.

Binary file added presentationPowerPoint_updated_ELECTRA(1).pptx
Binary file not shown.
862 changes: 862 additions & 0 deletions project_3_nlp_complete_study_notebook.ipynb

Large diffs are not rendered by default.

Loading