Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

通过Sin预测Cos实例中，RNN的前向传播函数可能存在问题 #115

Open
RobotMo opened this issue Feb 24, 2021 · 1 comment
Open

通过Sin预测Cos实例中，RNN的前向传播函数可能存在问题 #115

RobotMo opened this issue Feb 24, 2021 · 1 comment

Comments

@RobotMo
Copy link

RobotMo commented Feb 24, 2021

案例中，样本维度为1，序列长度为TIME_STEP（batch_size从网络结构来看似乎是默认为1），同一个序列中不同样本之间存在关联，但是同一个batch中的不同序列之间以及不同batch之间是不存在关联的，所以此处RNN网络结构的前向传播函数中，不需要加加入上一个batch的隐藏状态。
如果按案例中所写，训练过程中表现确实会越来越好，但是放到训练过程之外，使用独立的样本测试的时候效果似乎不太理想
@daijiuqian
Copy link

他代码写的切断连接,但是实际上是传入了上一个epoch的隐藏状态.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@RobotMo @daijiuqian