Bonky Zhu
If someone is able to show me that what I think or do is not right, I will happily change, for I seek the truth, by which no one was ever truly harmed. It is the person who continues in his self-deception and ignorance who is harmed.

# WAIS：联合意图检测和槽填充的单词注意力

## Methodology

$$c_{i}^{s}=\sum_{j=1}^{T} \alpha_{i, j}^{s} h_{j}$$

$$\alpha_{i, j}^{s}=\frac{\exp \left(e_{i, j}\right)}{\sum_{k=1}^{T} \exp \left(e_{i, k}\right)}$$

$$e_{i, k}=\sigma\left(W_{h}^{s} h_{k}\right)$$

$$y_{i}^{s}=\operatorname{Softmax}\left(W_{h y}^{s}\left(h_{i}+c_{i}^{s}\right)\right)$$

$$y^{I}=\operatorname{Softmax}\left(W_{h y}^{I}\left(h_{T}+c^{I}\right)\right)$$

$$\beta_{i j}=\frac{\exp \left(e_{i j}^{\beta}\right)}{\sum_{k=1}^{T} \exp \left(e_{i k}^{\beta}\right)}$$

$$e_{i j}^{\beta}=V^{T} \tanh \left(W_{h y}^{w} x_{j}\right)$$

$$c_{i}^{\omega}=\sum_{j=1}^{T} \beta_{i j} x_{j}$$

$$c_{g}=\lambda \odot c_{i}^{s}+(1-\lambda) \odot c_{i}^{\omega}$$

$$\lambda=V_{1}^{T} \tanh \left(W_{1} c_{i}^{s}+W_{2} c_{i}^{\omega}\right)$$

$$y_{i}^{s}=\operatorname{Softmax}\left(W_{h y}^{s}\left(h_{i}+c_{g}\right)\right)$$

$$y^{I}=\operatorname{Softmax}\left(W_{h y}^{I}\left(h_{T}+c^{I}+c_{g}\right)\right)$$

Share