Skip to content

[FIX TODO] explained why the sentence_length is checked #9

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
tilaboy wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[FIX TODO] explained why the sentence_length is checked #9

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 9 additions & 1 deletion word2vec.c
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -847,7 +847,15 @@ void *TrainModelThread(void *id) {

// This 'if' block retrieves the next sentence from the training text and
// stores it in 'sen'.
// TODO - Under what condition would sentence_length not be zero?
//
// Note the main while loop do two things:
// 1. run this 'if' block to prepare sentence, and
// 2. move one word forward in current sentence, i.e., 'sentence_position++',
// prepare context and target, and do the forward computation and backward
// propagation
//
// the if statement here check whether the training process just start or just
// finished the last sentence, and need to prepare a new sentence to do part 2
if (sentence_length == 0) {
while (1) {
// Read the next word from the training data and lookup its index in
Expand Down