#Language and Computers

[drlinguo]

Language and computers (Open Access)

Lelia Glass, Markus Dickinson, Chris Brew, Detmar Meurers

This book offers an accessible introduction to the ways that language is processed and produced by computers, a field that has recently exploded in interest. The book covers writing systems, tools to help people write, computer-assisted language learning, the multidisciplinary study of text as data, text classification, information retrieval, machine translation, and dialog. Throughout, we emphasize insights from linguistics along with the ethical and social consequences of emerging technology. This book welcomes students from diverse intellectual backgrounds to learn new technical tools and to appreciate rich language data, thus widening the bridge between linguistics and computer science.

[noosphe-re]

"There was an exchange on Twitter a while back where someone said, ‘What is artificial intelligence?' And someone else said, 'A poor choice of words in 1954'," he says. "And, you know, they’re right. I think that if we had chosen a different phrase for it, back in the '50s, we might have avoided a lot of the confusion that we're having now." So if he had to invent a term, what would it be? His answer is instant: applied statistics. "It's genuinely amazing that...these sorts of things can be extracted from a statistical analysis of a large body of text," he says. But, in his view, that doesn't make the tools intelligent. Applied statistics is a far more precise descriptor, "but no one wants to use that term, because it's not as sexy".

'The machines we have now are not conscious', Lunch with the FT, Ted Chiang, by Madhumita Murgia, 3 June/4 June 2023

[theonewhowails]

do you ever wonder how old the twins are? how long have they been with the one who waits? do you ever think about how much of that time in the veil narinder spent totally alone, about how much of a stabilizing presence it might have been to have literally else around, after all that time? i think about it a completely normal amount, personally,

[dkettchen]

you know english infiltrating other languages due to the internet has become a problem when even the french are doing it

[elbiotipo]

I'm not a linguist and I find the whole excercise of conlanging, while I love it and respect it, beyond my abilities, but I do have one thing or two to say about linguistic diversity and how boring is to have a "common" or "basic" language in fantasy or science fiction without exploring the implications.

Being a bilingual speaker of Spanish and English, and someone that because of work reasons and entertaiment tastes interacts a lot with English, I tend to see English as the equivalent of those "common" or "basic" languages of speculative fantasy. As a useful tool for communication, science technology and commerce. In real life, however, as you are aware, the expansion of English tends to undermine local languages, it's considered more valuable to know English that to know the language of your grandparents, or learn any other language you just feel curious about.

The experiences of every multilingual person are different, but in mine I know English, I write and read and listen to English a lot. But I don't consider myself an English *speaker*, I speak Spanish and more to the point Argentine Spanish, that's the culture I identify with, and it's the language I use to express my feelings and inner thoughts. I can't imagine saying "I love you" to anyone in English, to me it's just a tool I use to access to knowledge or communicate through language barriers ("basic", "common"). But interestingly, by both writing and participating in the wider English-speaker internet culture, isn't it part of my own culture, as an individual, too?

The fact is that English also has a culture(s) and a history and a corpus of literature. So when we write about "Common" or "Basic" languages in fiction we need to ask ourselves: where did they come from? How did they become the standard? Is there a literature, a canon, a culture of "Common" in your fantasy world? What about other languages, other cultures that aren't raised learning it and see it just as a tool? Because no matter the strenght of Anglophone cultural imperialism and the social value of learning English, I don't see Argentines, or for that matter Chinese, Italians or Russians abandoning their first language. And yet even in English and in all other languages (ESPECIALLY other languages, English is remarkably uniform) there is a variety of dialects. And we need to remember, once Latin was spoken only in a village in central Italy, and English in a rather remote rainy island. They weren't destined to have their future roles, history drives language.

So, when an author goes for the "universal language" explanation to avoid linguistic misunderstandings, for me, it raises more questions that I believe are worth exploring.

[prokopetz]

Techbro marketing's conflation of generative language models with the term "artifical intelligence" to the point that many laypersons now think that's what AI is definitely sucks for, like, literally everybody who's working in genuine AI research, but I have to grant the way it's gotten tangled up with other historically inappropriate uses of the term "artificial intelligence" is a little bit funny. I've seen multiple unconnected discussions involving people seizing on the "AI is inherently unethical" talking point and getting heated about bad guys in single-player video games having "AI", and, like, I'd be fascinated to know what the alternative is. I'm trying to imagine a world where it's feasible for every individual goomba in Super Mario Bros. to be directed by a human operator, and I'm not sure I can, but it's definitely a place I'd like to visit.

[tenowls]

rivals

[sunnythedawg]

Next part of the silly thing

[thunderc1an]

Hollyleaf- ms paint with a mouse

[kitty-0verl0rd]

happy robot sex year yay yippee

[dreamdolldeveloper]

back to basics

mostly free resources to help you learn the basics that i've gathered for myself so far that i think are cool

everyday

gcfglobal - about the internet, online safety and for kids, life skills like applying for jobs, career planning, resume writing, online learning, today's skills like 3d printing, photoshop, smartphone basics, microsoft office apps, and mac friendly. they have core skills like reading, math, science, language learning - some topics are sparse so hopefully they keep adding things on. great site to start off on learning.

handsonbanking - learn about finances. after highschool, credit, banking, investing, money management, debt, goal setting, loans, cars, small businesses, military, insurance, retirement, etc.

bbc - learning for all ages. primary to adult. arts, history, science, math, reading, english, french, all the way to functional and vocational skills for adults as well, great site!

education.ket - workplace essential skills

general education

mathsgenie - GCSE revision, grade 1-9, math stages 1-14, provides more resources! completely free.

khan academy - pre-k to college, life skills, test prep (sats, mcat, etc), get ready courses, AP, partner courses like NASA, etc. so much more!

aleks - k-12 + higher ed learning program. adapts to each student.

biology4kids - learn biology

cosmos4kids - learn astronomy basics

chem4kids - learn chemistry

physics4kids - learn physics

numbernut - math basics (arithmetic, fractions and decimals, roots and exponents, prealgebra)

education.ket - primary to adult. includes highschool equivalent test prep, the core skills. they have a free resource library and they sell workbooks. they have one on work-life essentials (high demand career sectors + soft skills)

youtube channels

the organic chemistry tutor

khanacademy

crashcourse

tabletclassmath

2minmaths

kevinmathscience

professor leonard

greenemath

mathantics

3blue1brown

literacy

readworks - reading comprehension, build background knowledge, grow your vocabulary, strengthen strategic reading

chompchomp - grammar knowledge

tutors

not the "free resource" part of this post but sometimes we forget we can be tutored especially as an adult. just because we don't have formal education does not mean we can't get 1:1 teaching! please do you research and don't be afraid to try out different tutors. and remember you're not dumb just because someone's teaching style doesn't match up with your learning style.

cambridge coaching - medical school, mba and business, law school, graduate, college academics, high school and college process, middle school and high school admissions

preply - language tutoring. affordable!

revolutionprep - math, science, english, history, computer science (ap, html/css, java, python c++), foreign languages (german, korean, french, italian, spanish, japanese, chinese, esl)

varsity tutors - k-5 subjects, ap, test prep, languages, math, science & engineering, coding, homeschool, college essays, essay editing, etc

chegg - biology, business, engineering/computer science, math, homework help, textbook support, rent and buying books

learn to be - k-12 subjects

for languages

lingq - app. created by steve kaufmann, a polygot (fluent in 20+ languages) an amazing language learning platform that compiles content in 20+ languages like podcasts, graded readers, story times, vlogs, radio, books, the feature to put in your own books! immersion, comprehensible input.

flexiclasses - option to study abroad, resources to learn, mandarin, cantonese, japanese, vietnamese, korean, italian, russian, taiwanese hokkien, shanghainese.

fluentin3months - bootcamp, consultation available, languages: spanish, french, korean, german, chinese, japanese, russian, italian.

fluenz - spanish immersion both online and in person - intensive.

pimsleur - not tutoring** online learning using apps and their method. up to 50 languages, free trial available.

incase time has passed since i last posted this, check on the original post (not the reblogs) to see if i updated link or added new resources. i think i want to add laguage resources at some point too but until then, happy learning!!

[techav]

On Multitasking

Sharing a Computer with Friends

The Motorola 68030 was a decently powerful microprocessor for its day. It is a fully 32-bit processor with 16 general-purpose registers, separate instruction & data caches, memory management unit, 18 addressing modes, over 100 instructions, pipelined architecture, and was available rated up to 50MHz. It was used in computers by Apple, Amiga, NeXT, Sun, Atari, and saw further life embedded in devices such as printers, oscilloscopes, and network switches. It was the kind of microprocessor used for desktop publishing, 3D CAD & animation, photo & video editing, etc.

In short, the 68030 is a microprocessor that can do some serious work. That's part of why I like it so much. It's a real workhorse chip but as far as 32-bit microprocessors go, it's dead simple to build with.

But running a single quick & simple BASIC program hardly seems like an adequate exercise for such a capable chip.

There is a prevailing claim that the 68000 architecture was heavily inspired by that of the PDP-11 or VAX minicomputers — powerhouses of the previous generation of computing. These machines ran entire businesses, at times servicing many simultaneous users. Surely the 68030 with similar capabilities but significantly faster instruction throughput than the decade-older machines would be more than capable of handling such a workload.

As I've mentioned before, one of my end goals for my 68030 projects is to run a proper operating system. Something like System V, BSD, or Linux; a true multi-user system befitting of the 68k's architectural heritage. My programming skills are limited, and getting such a complex project running is still outside my reach. But I am learning, and slowly inching myself closer to that goal.

Recently I built an expansion card for my Wrap030 project to add another four serial ports to it. In the context of the old minicomputers, another serial port means another terminal, which means the ability to serve one more user. My new 4-port serial card should give me the ability to add four new user terminals.

If only I had software capable of doing so.

Excluding symmetric multiprocessing and today's multi-core behemoths, supporting multiple user processes on a single computer processor means dividing time between them. The computer will run one user's program for a little while, then stop and run another user's program for a little while. Do this fast enough and neither user might ever notice that the computer is paying attention to someone else — especially since the computer spends much of its time just waiting for user input.

There are a few ways to accomplish this, but the simplest is to just make sure that every user program is written to cooperate with the others and periodically yield to the next user program ("Cooperative Multitasking"). A good time to do this is whenever the program needs to wait for input from the user or wait for a device to be ready to accept output.

Enhanced BASIC (68k EhBASIC), which I have been running on all of my 68k computer builds, was written in such a way that lends itself well to this sort of cooperative multitasking. It runs a tight loop when waiting for input or output, and while running a BASIC program, it stops at the end of each line to see if the user has pressed Ctrl-C to stop the program. This means that EhBASIC never goes too long without needing to check in with slow I/O devices. All that would needed is a simple kernel to set things up and switch to another user's processes whenever each time one of them is waiting for I/O.

So I set about creating such a minimal multi-user kernel. On startup, it initializes hardware, sets up some data tables for keeping track of what each user program is doing, loads BASIC into RAM, then starts running BASIC for that first user. Whenever a user process needs to read data from or write data to its terminal, it asks the kernel to handle that I/O task for it. The kernel will save the state of the user program to the data table it set up in the beginning, then switch to the next user to let it run until it too asks for assistance with an I/O task.

The kernel works through all user processes round-robin until it loops back around to the first user. After restoring the state of the user's process the kernel will service the I/O task that user process had originally requested, and return to let that user process run for a little while again. So all of the other user processes get their chance to run while one is waiting on data, and each process makes sure to allow the others a chance to run for a while when they are in the middle of running their own program.

I was able to throw together a quick proof of concept using the EASy68K simulator. What followed was days of catching all of the tiny mistakes I made, such as saving register A0 to the memory location reserved for register A1, overwriting the value previously saved for A1 and effectively losing both in the process — an error which resulted in BASIC printing only the first three characters of its startup header followed by a long string of null characters.

Debugging was tricky. I was starting from the bottom. No standard library, no existing structure or frameworks to rely on. The kernel process relied on the very same registers the user programs were using. Any changes to register contents by the kernel would affect the user processes. I ended up adding assembly macros to print short statements and register contents to the kernel console to try to get some insight into what was happening. I was able to track when registers came out of the user context save/restore process different than when they went in to find where I had bugs in that process.

This was a challenging project resulting in nearly a thousand lines of very low-level 68k assembly code, all of which I wrote and rewrote multiple times before figuring everything out. I've written small pieces of assembly code over the years, but none which required such deep dives into the CPU documentation to discern fine details of how the chip operates. I got there eventually though and now I have an 8MHz 68030 homebrew computer with 2MB of RAM that can run four BASIC programs simultaneously.

I'm going to need more terminals.

[niamhthefae]

guys. edwin canonically speaks multiple languages. george rextrew speaks multiple languages.

what if in season 2 they meet someone who only speaks like, french (for the sake of this scenario) or something. and none of them know what to do, and edwin just bursts out in PERFECT FRENCH and when the client has left he just goes "my french is a little rusty so it might be a bit wrong here and there but i think i got it :)" and everyone just dies because how on earth did that just happen

[riseandfallofsecunit]

Murderbot collects swear words

[prokopetz]

I'm trying to debug a fairly subtle syntax error in a customer inventory report, and out of sheer morbid curiosity I decided to see what my SQL syntax checker's shiny new "Fix Syntax With AI" feature had to say about it.

After "thinking" about it for nearly a full minute, it produced the following:

SELECT SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION SELECT COUNT(id) FROM customers WHERE customers.deleted = 0 AND customers.id = NULL UNION

I suspect my day job isn't in peril any time soon.