[-] dsilverz@thelemmy.club 26 points 2 days ago

Also, they're thinking of the northern hemisphere only. The world has another hemisphere, the southern hemisphere, where it's now summer.

18
submitted 2 weeks ago* (last edited 2 weeks ago) by dsilverz@thelemmy.club to c/artshare@lemmy.world

"I've been waiting for so long to finally reach to you. It's time, ready to go back home?"

(Alt text: A drawing containing two bubble-like creatures under a dark otherworldly sky. The leftmost creature is a pink slime, it seems naive and has a speechless, surprised expression. The rightmost creature, resembling a Grim Reaper, is dark gray, has red eyes, is carrying a scythe, and casts a shadow on the ground that suggests hovering. A speech balloon above the Grim Reaper says "No time, no see... Hello, my dear")

180
Yin and Yang (thelemmy.club)
submitted 1 month ago by dsilverz@thelemmy.club to c/cat@lemmy.world
6

cross-posted from: https://thelemmy.club/post/17993801

First of all, let me explain what "hapax legomena" is: it refers to words (and, by extension, concepts) that occurred just once throughout an entire corpus of text. An example is the word "hebenon", occurring just once within Shakespeare's Hamlet. Therefore, "hebenon" is a hapax legomenon. The "hapax legomenon" concept itself is a kind of hapax legomenon, IMO.

According to Wikipedia, hapax legomena are generally discarded from NLP as they hold "little value for computational techniques". By extension, the same applies to LLMs, I guess.

While "hapax legomena" originally refers to words/tokens, I'm extending it to entire concepts, described by these extremely unknown words.

I am a curious mind, actively seeking knowledge, and I'm constantly trying to learn a myriad of "random" topics across the many fields of human knowledge, especially rare/unknown concepts (that's how I learnt about "hapax legomena", for example). I use three LLMs on a daily basis (GPT-3, LLama and Gemini), expecting to get to know about words, historical/mythological figures and concepts unknown to me, lost in the vastness of human knowledge, but I now know, according to Wikipedia, that general LLMs won't point me anything "obscure" enough.

This leads me to wonder: are there LLMs and/or NLP models/datasets that do not discard hapax? Are there LLMs that favor less frequent data over more frequent data?

8
submitted 2 months ago by dsilverz@thelemmy.club to c/ai_@lemmy.world

First of all, let me explain what "hapax legomena" is: it refers to words (and, by extension, concepts) that occurred just once throughout an entire corpus of text. An example is the word "hebenon", occurring just once within Shakespeare's Hamlet. Therefore, "hebenon" is a hapax legomenon. The "hapax legomenon" concept itself is a kind of hapax legomenon, IMO.

According to Wikipedia, hapax legomena are generally discarded from NLP as they hold "little value for computational techniques". By extension, the same applies to LLMs, I guess.

While "hapax legomena" originally refers to words/tokens, I'm extending it to entire concepts, described by these extremely unknown words.

I am a curious mind, actively seeking knowledge, and I'm constantly trying to learn a myriad of "random" topics across the many fields of human knowledge, especially rare/unknown concepts (that's how I learnt about "hapax legomena", for example). I use three LLMs on a daily basis (GPT-3, LLama and Gemini), expecting to get to know about words, historical/mythological figures and concepts unknown to me, lost in the vastness of human knowledge, but I now know, according to Wikipedia, that general LLMs won't point me anything "obscure" enough.

This leads me to wonder: are there LLMs and/or NLP models/datasets that do not discard hapax? Are there LLMs that favor less frequent data over more frequent data?

4

The following story was written by me, playing with the concept of myse en abyme (among other deeper concepts within the text, such as philosophical and esoteric intertwined concepts).

Myse en abyme is a type of art that contains the art within itself, creating a meta-narrative. I'm sharing this to bring this concept to those who were not familiar with it.

I'm using a made-up pseudonym "Bob DeLorean" to compose the text.

Please let me know if i'm sharing the wrong way (i.e. if I'm supposed to publish it through another platform and sharing links, instead of sharing the entire story through a Lemmy post).


How do you make a story within the story itself? - A meta-fiction By Bob DeLorean (my pseudonym for this Myse En Abyme kind of story)

"How do you make a story within the story itself? Bob was wondering that. 'You start by thinking about the steps. It's quite simple, son, take this ancient book. It's yours. Literally yours', answered the priest, while handing a dusty book entitled 'How do you make a story within the story itself' authored by 'Bob'.

He opened it, just to face his own story right at the first page: 'How do you make a story within the story itself? Bob was wondering that'.

– Hey, it's my story! – he wondered, scared. – Where did you get it?

The priest answered:

– A long, long time ago, some minutes before this sentence, Bob started to wrote. Look, son, you're a prophet, a really gifted prophet. You should be proud of yourself.

– It doesn't make sense. How should I... how should I know?

– You really wrote it, son. Turn the page.

Bob turned the page. The second page started... 'Bob turned the page. The second page started...'. The rest was blurry, but gradually faded into existence. His eyes couldn't believe it. He read the next line: 'The rest was blurry, but gradually fading into existence'.

– Which type of witchcraft is this?

– It's not, son. It's your story, you really should be proud of yourself.

– But you said that I wrote this, right?

– Exactly, son. You wrote that.

– And how I can't remember?

– You do remember, son. Read it again.

He tried to look the next pages. All blurry, because we're still going to the third page. Bob should know that.

– Wait.. I heard it. Who's that?

It's me, Bob.

– No, I am Bob. You're not.

I'm Bob, Bob.

– Wh... No way! Tell my last name.

It's DeLorean. Bob DeLorean is our name. He looks surprised.

– Of course I'm surprised. What happens with me, at the end?

You mean... with us. Well, for you, I have somber news. You vanish as soon as I stop writing. As for me, I dunno, I'll probably write other texts.

– It's not fair. Am I gonna die?

– Hey, son, are you talking to God? – the priest asked.

– N... no. I'm talking to a voice that's claiming to be myself. Take this book back.

A mysterious force was stopping Bob from giving away his own book. You can't do it, Bob. You know you can't. Only you can read the book, for now.

– He's claiming that only me can read the book. And he keeps narrating some story, this story, it's creepy.

– Oh, it's God! God's right, son! The book is yours. It's meant for yourself.

– You should try to read it, priest...

– I can't defy God, my son. If the book is yours, I can't even touch it.

– You touched it minutes ago.

– It was God's mission to deliver the book for you, son. I simply delivered it as God wisely ordered me.

Hey, Bob, are you listening?

– Uh... yeah?

Say to the priest that he can stop calling me as god.

– Hey... priest... Can you hear him?

– No, son. I can't hear God.

– He asked you to stop calling him "god".

– Beware of your words, son. He's God.

– But he literally asked me. Look...

Bob proceeded to the fourth page, where I said 'Say to the priest that he can stop calling me as god'.

– Wait... I c... I can read it, son!

– Exactly! See?

– If God asked to not be called God, I'll respect God's Will and I'll stop calling God as God.

Humph...

– He seems infuriated.

– I can see it, son. It's right below the prophetic paragraph you delivered to me.

I'm becoming tired. I should sto...

– No!! I'm gonna die if you stop!

I don't care, Bob.

– But I'm... I'm you, you said it before!

Yeah. I'm you, Bob. And I'm deciding to stop my own story: the ancient book was slim, with five pages only. The priest and Bob went to sleep. Don't worry, I'm taking care of them. Maybe we'll awake inside another book in the future."

19

Firstly, sorry if this is not the adequate place for my question; if it's the case, let me know.

The title may seem confusing, so let me detail it: I'm more of a commenter person, and some of my comments are replied, and Lemmy notifies me of those direct replies. However, there are moments when those replies receive third-party replies, so my comment turns into some kind of "sub-thread", something that's interesting for me to read and follow. For those third-party replies, I don't receive notifications, so I have to access each direct reply that was notified so to find possible "sub-threads".

There seems to me to be no option to "receive notifications for this post/comment/reply", only the automatic opt-in of notifications for direct replies.

So really isn't there such an option? Or is this an instance-specific feature and the instance I belong to (thelemmy.club) don't have it?

view more: next ›

dsilverz

joined 4 months ago