Skip to content

DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.

2.1 KB
Raw Blame
<!doctype html>
<html lang="en">
  <head>
    <meta charset="utf-8">
    <title>Transformer (deep learning)</title>
  </head>
  <body>
    <a class="skiplink" href="#content">Jump to content</a>
    <header class="siteheader">
      Main menu Navigation Main page Contents Current events Random article
    </header>
    <aside class="vector-toc-landmark" role="navigation">
      <p>(Top) 1 History Toggle History subsection 1.1 Predecessors</p>
    </aside>

    <div class="mw-page-container">
      <div class="mw-content-container">
        <main id="content" class="mw-body" role="main">
          <header class="mw-body-header">
            <h1>Transformer (deep learning)</h1>
          </header>
          <div id="bodyContent" class="vector-body">
            <div id="mw-content-text" class="mw-body-content">
              <div class="mw-content-ltr mw-parser-output">
                <p>A transformer is a neural-network architecture built around attention mechanisms.</p>

                <!-- Vector/Parsoid pages contain comments between article nodes. -->
                <div class="mw-heading mw-heading2">
                  <h2 id="History">
                    <span class="mw-headline">History</span>
                    <span class="mw-editsection"><a href="/edit">edit</a></span>
                  </h2>
                </div>
                <p>The architecture followed earlier sequence models.</p>

                <div class="mw-heading mw-heading3">
                  <h3 id="Predecessors"><span>Predecessors</span></h3>
                </div>
                <p>Recurrent networks processed tokens one at a time.</p>

                <div class="mw-heading mw-heading2">
                  <h2 id="Applications"><span>Applications</span></h2>
                </div>
                <p>Transformers are used for language, vision, and audio.</p>

                <table class="navbox">
                  <tr><td>v t e Example AI navigation footer</td></tr>
                </table>
              </div>
            </div>
          </div>
        </main>
      </div>
    </div>

    <footer>Privacy policy About this site Contact us</footer>
  </body>
</html>