Mabble Rabble

random ramblings & thunderous tidbits

1 November 2022

Survey of Pre-Trained Transformer Models

Survey of Pre-Trained Transformer Models

Labels: big data , data science , deep learning , machine learning , natural language processing , text analytics
Newer Post Older Post Home

Hot Trends UK

Loading...

Topics

.Net agile akka america android apache API appengine apple art artificial intelligence bbc BDD beer big data bing blogs burger c c++ cassandra christmas Cloud cognitive collaboration commonsense reasoning computer science computer vision conspiracy theory contextual ads cordova crime crypto CSS CXF cyclists Dart data science data.gov data.gov.uk databases dbpedia deep learning derbyjs developer devops disqus distributed systems dmoz drama dropwizard ecommerce economics entertainment ethics event event-driven events facebook finance fireworks fish flash flink food football fraud freebase games git Go Google Google Glass googletv gossip groovy GWT hadoop hbase health heroku hosting html human resources information retrieval infuencegraph innovation intelligent web intensedebate interaction design interface design internet interviews Java JavaScript JEE jetsons jobsearch jokes julia kafka kotlin legal library lifesciences linked data London mac machine learning maps media memory message-driven metadata meteorjs microservices Microsoft mobile movie movies moz multiagents music musicbrainz natural language processing nature nelson mandela network science neuroscience news nim nodejs nosql ocr odi Olympics online learning ontology open source opencharties opencorporates openspending opinion pair programming paralympics PHP pizza playframework playn politics predictive analytics programming prolog property public services publishing pyrotechnics python quantum computing R rain rdf reactive recommender reinforcement learning rest restify restlet Ruby rust sailsjs sales sandwiches scala scrum security semantic web sentiment analysis sentiments sentiwordnet social media analytics social networks socialgraph society software engineering spark sparql sport sports spring squash startups steaks stumbleupon sushi swagger swift taxpayers TDD telecommunications text analytics tomcat transit travel trends tv tv drama twisted typesafe ubiquitous computing uk vertx virtual reality visualization web design webcrawler webscraper webservices workplace world bank world cup world event world events yahoo

Word of the Day

Loading...

Wikipedia

Search results

DataTau

Loading...

Search Engine Land

Loading...

Natural Language Processing

Loading...

WildML

Loading...

KurzweilAI

Loading...

33rd Square

Loading...

Artificial Intelligence Blog

Loading...

Singularity Weblog

Loading...

Skymind

Loading...

CMU LTI

Loading...

Explosion AI

Loading...

IEEE Spectrum

Loading...

CSAIL

Loading...

Popular Science - Robots

Loading...

ArXiv

Loading...

GitXiv

Loading...

ScienceDaily: AI News

Loading...

DZone

Loading...

InfoWorld Big Data

Loading...

InfoWorld Cloud Computing

Loading...

Dataversity

Loading...

Datanami

Loading...

R-bloggers

Loading...

FlowingData

Loading...

KDnuggets

Loading...

FastML

Loading...

Smashing Magazine

Loading...

ProgrammableWeb

Loading...

AWS Blog

Loading...

NYT Technology

Loading...

Digital Trends

Loading...

Mashable!

Loading...

Wired

Loading...

Computerworld

Loading...

The Register

Loading...

The Next Web

Loading...

ReadWrite

Loading...

Lifehacker

Loading...

Hot Trends US

Loading...

Today

Loading...

Metacritic

Loading...

BuzzFeed

Loading...

TMZ.com

Loading...

Reuters

Loading...

The Huffington Post UK

Loading...

The Huffington Post US

Loading...

BBC

Loading...

Google News

Loading...

Digg Top Stories

Loading...

Fark

Loading...

USATODAY

Loading...

Upstract

Loading...

NYT World

Loading...

TechCrunch

Loading...

MarketWatch - Bulletins

Loading...

MarketWatch - StockWatch

Loading...

Stock Picks

Loading...

Investopedia

Loading...

Science News

Loading...

New Scientist

Loading...

Scientific American News

Loading...

Discover: Top Stories

Loading...

Discovery News

Loading...

Popular Mechanics

Loading...

TEDTalks

Loading...

Links

  • AAAI
  • ACL
  • ACM
  • AI2
  • Alan Turing Institute
  • Allegrograph
  • AllenNLP
  • AlternativeTo
  • Amazon
  • Amazon Science
  • Anaconda
  • Apache Foundation
  • AppAdvice
  • Apple
  • Arxiv
  • AssociatedPress
  • AWS
  • BBC
  • Beam
  • BigDataUniversity
  • BigScience Workshop
  • BitBucket
  • Blazegraph
  • Cascading
  • Cassandra
  • CKan
  • Clips
  • Cloudera
  • CMU@LTI
  • Cohere.ai
  • Commonsense
  • Conceptnet
  • Confluent
  • CoreNLP
  • Coursera
  • CSAIL
  • Cyc
  • Databricks
  • DatabricksLabs
  • DataScienceMasters
  • DataScienceWeekly
  • Datastax
  • DBEngines
  • DBPedia
  • DeepLearning
  • Deeplearning4J
  • DeepMind
  • Deepset
  • Dice
  • DigitalOcean
  • DublinCore
  • DZone
  • EBay
  • Ebizmba
  • Ed@informatics
  • EDMC
  • Edx
  • Elastic
  • EleutherAI
  • Ethical Consumer
  • Flink
  • G2Crowd
  • Gate
  • Gensim
  • Getty
  • Github
  • Global Research
  • Google
  • Google Research
  • Grammatical Framework
  • GraphQL
  • Groovy
  • Hackernoon
  • Hadoop
  • HBO
  • Heritrix
  • Heroku
  • Hortonworks
  • HuggingFace
  • Institute for Quantitative Social Science
  • Janusgraph
  • Java
  • John Snow Labs
  • JSON-LD
  • Julia
  • Kaggle
  • KBpedia
  • KDNuggets
  • Kotlin
  • LaionAI
  • Lazy Programmer
  • LDC
  • Lemon
  • LinkedData
  • LonelyPlanet
  • Lucene
  • Manning
  • MapR
  • MediaBiasGroup
  • Mediacloud
  • Meetup
  • MetaResearch
  • Microservices.io
  • MIT Courseware
  • MongoDB
  • Mozilla
  • MXNET
  • Netflix
  • NetflixOSS
  • NLP Progress
  • Nodejs
  • NOW Publishers
  • NVIDIA
  • OAQA
  • Ontocord
  • Ontotext
  • OpenAI
  • OpenCV
  • OpenMath
  • OpenNLP
  • Oracle
  • Oreilly
  • OWL 2
  • Packtpub
  • Paperswithcode
  • PoolParty
  • Pragmatic Bookshelf
  • PyData
  • Python
  • PyTorch
  • PyWhy
  • R
  • RDF
  • RDFS
  • Redis
  • ResearchGate
  • Scala
  • Scholarpedia
  • Schrodinger
  • scikit-learn
  • Scrapy
  • Scylladb
  • Semantic Web
  • Skillsmatter
  • SKOS
  • SmashingMagazine
  • Solace
  • Solr
  • SoundCloud
  • Spark
  • SPARQL
  • Stackshare
  • Stanbol
  • StanfordNLP
  • Stardog
  • Strata
  • Streamsets
  • SWRL
  • Tatsu
  • Tensorflow
  • The Marshall Project
  • Theano
  • TheTopTens
  • ThomsonReuters
  • Timeout
  • Tinkerpop
  • TIOBE
  • Titan
  • Together
  • Tutorialspoint
  • Twitter
  • Udacity
  • Udemy
  • UIMA
  • Umbel
  • VastAI
  • W3C
  • W3C Community Groups
  • W3CSchools
  • Wazo
  • Wikidata
  • Workforce Data Initiative
  • XPath
  • XQuery
  • Youtube
Posts
Atom
Posts
Comments
Atom
Comments

Archive

  • ►  2024 ( 64 )
    • ►  November ( 17 )
    • ►  October ( 32 )
    • ►  September ( 2 )
    • ►  June ( 1 )
    • ►  May ( 6 )
    • ►  April ( 2 )
    • ►  March ( 3 )
    • ►  January ( 1 )
  • ►  2023 ( 94 )
    • ►  December ( 16 )
    • ►  November ( 3 )
    • ►  October ( 4 )
    • ►  September ( 9 )
    • ►  August ( 7 )
    • ►  July ( 11 )
    • ►  June ( 11 )
    • ►  May ( 11 )
    • ►  April ( 8 )
    • ►  March ( 10 )
    • ►  February ( 2 )
    • ►  January ( 2 )
  • ▼  2022 ( 133 )
    • ►  December ( 16 )
    • ▼  November ( 5 )
      • Psychopathic AI
      • Debatabase
      • Why Coding Tests Are Bad
      • Programs in Cognitive Science
      • Survey of Pre-Trained Transformer Models
    • ►  October ( 7 )
    • ►  September ( 8 )
    • ►  August ( 14 )
    • ►  July ( 29 )
    • ►  June ( 18 )
    • ►  May ( 16 )
    • ►  April ( 9 )
    • ►  March ( 7 )
    • ►  February ( 2 )
    • ►  January ( 2 )
  • ►  2021 ( 90 )
    • ►  December ( 2 )
    • ►  November ( 1 )
    • ►  August ( 7 )
    • ►  July ( 4 )
    • ►  June ( 33 )
    • ►  May ( 10 )
    • ►  April ( 5 )
    • ►  March ( 8 )
    • ►  February ( 5 )
    • ►  January ( 15 )
  • ►  2020 ( 229 )
    • ►  December ( 39 )
    • ►  November ( 12 )
    • ►  October ( 10 )
    • ►  September ( 14 )
    • ►  August ( 10 )
    • ►  July ( 21 )
    • ►  June ( 18 )
    • ►  May ( 14 )
    • ►  April ( 14 )
    • ►  March ( 26 )
    • ►  February ( 20 )
    • ►  January ( 31 )
  • ►  2019 ( 256 )
    • ►  December ( 19 )
    • ►  November ( 17 )
    • ►  October ( 67 )
    • ►  September ( 17 )
    • ►  August ( 19 )
    • ►  July ( 15 )
    • ►  June ( 40 )
    • ►  May ( 27 )
    • ►  April ( 11 )
    • ►  March ( 3 )
    • ►  February ( 1 )
    • ►  January ( 20 )
  • ►  2018 ( 133 )
    • ►  December ( 17 )
    • ►  October ( 1 )
    • ►  September ( 1 )
    • ►  August ( 2 )
    • ►  July ( 4 )
    • ►  June ( 12 )
    • ►  May ( 9 )
    • ►  April ( 29 )
    • ►  March ( 10 )
    • ►  February ( 23 )
    • ►  January ( 25 )
  • ►  2017 ( 275 )
    • ►  December ( 24 )
    • ►  November ( 9 )
    • ►  October ( 25 )
    • ►  September ( 28 )
    • ►  August ( 4 )
    • ►  July ( 8 )
    • ►  June ( 5 )
    • ►  May ( 20 )
    • ►  April ( 35 )
    • ►  March ( 57 )
    • ►  February ( 37 )
    • ►  January ( 23 )
  • ►  2016 ( 90 )
    • ►  December ( 2 )
    • ►  November ( 4 )
    • ►  October ( 13 )
    • ►  September ( 24 )
    • ►  August ( 14 )
    • ►  June ( 11 )
    • ►  May ( 6 )
    • ►  April ( 3 )
    • ►  March ( 9 )
    • ►  February ( 4 )
  • ►  2015 ( 36 )
    • ►  December ( 2 )
    • ►  November ( 1 )
    • ►  October ( 4 )
    • ►  September ( 2 )
    • ►  July ( 3 )
    • ►  May ( 2 )
    • ►  April ( 1 )
    • ►  March ( 4 )
    • ►  February ( 9 )
    • ►  January ( 8 )
  • ►  2014 ( 201 )
    • ►  December ( 1 )
    • ►  November ( 8 )
    • ►  October ( 12 )
    • ►  September ( 11 )
    • ►  August ( 12 )
    • ►  July ( 19 )
    • ►  June ( 22 )
    • ►  May ( 11 )
    • ►  April ( 27 )
    • ►  March ( 46 )
    • ►  February ( 24 )
    • ►  January ( 8 )
  • ►  2013 ( 77 )
    • ►  December ( 39 )
    • ►  October ( 4 )
    • ►  September ( 2 )
    • ►  August ( 9 )
    • ►  July ( 5 )
    • ►  June ( 3 )
    • ►  May ( 4 )
    • ►  April ( 5 )
    • ►  March ( 3 )
    • ►  February ( 3 )
  • ►  2012 ( 35 )
    • ►  December ( 14 )
    • ►  November ( 2 )
    • ►  September ( 7 )
    • ►  August ( 4 )
    • ►  July ( 8 )
Copyright © 2024. All rights reserved. Theme images by Ollustrator. Powered by Blogger.