Category: English

  • The End of a World : 21 December 2012

    Well, it is a quite current subject, as I can find many things about it just through making a search on Google. So after having been captivated by this date for a few days, I will give you a probable version of it. Because I think something will really happen on December 21, or not.

    My scenario of this 21st December is a digital holocaust (I have found no satisfying term to describe it) making mechanically other events happen: one country, which has build a defense against other country’s attack is attacked. This system strikes back by attacking the country from which the attack has been lead, leading the Internet connection to be overflooded and thus unable to complete anything for hours. But the system has a side effect making it strike another country. The latter attacks but due to side effect, other countries are also affected. At each attack the entire bandwidth of a country is affected to “war effort”.

    Sure, during that date, many things will happen: many sects on this world will commit collective suicide or occupy massively a place that is not made for. Many nations will have their Internet connection cut, so they can not be aware of what’s happening, even in their own country. Most people will be unable to telephone due to the Net War. Everyone will be disconnected to each other, and breaking news won’t have many readers.

    A financial crisis due to internet shutdownCut to the rest of the world, the markets of London, Paris, Tokyo or New York will go mad: the price of precious and rare raw materials is increasing, making the insecurity growing: you will likely to be killed for detaining on you precious items such as telephone, or golden artefacts (rings, necklaces…). In response to this, the government will increase the number of policemen operating in cities, but this has quite huge repercussion on the State’s budget, making national debt increase. Debt increase is not appreciated by the markets, and already very fragile States will be going to lack money to pay all their civil servants. To avoid this, taxes will be increased in order to have some funds to make the State and all its institution work… temporarily.

    Tax increases are never appreciated, even more in economic crisis. In fragile countries (Spain, Greece, Portugal…), the situation will turn into civil war. As money got from taxes goes decreasing. As there is no money anymore to pay them, civil servants are fired, and become officially unemployed. Actually many people will do unreported employment. For the few people still working reportedly, dissatisfaction towards the government policy will grow, leading to more and more frequent and violent demonstrations. To be able to contain demonstrations, the police will become more and more violent, making demontrations become carnage and bloodshed. But due to markets holding governments by their balls tax will increase again and again. But without any effect as already more than 80% of people have at least one unreported work. This is a great loss for taxes, so these 80% will be stalked by the government, leading to civil war.

    Overflooded by stalking workers trying to survive, and by robbers breaking everyone’s home, policemen no longer grant security in cities. So more and more people leave these cities for the surrounding countrysides. People will be organised in small communities, with their own militia to defend the community’s property. The State no longer exists. It is the end of a word: the one we knew before.

  • Search on Google using Python scripts

    What about a free unlimited Google API? In the past, Google provided such thing, but it is definitely deprecated (due to abuses?). The new Search API needs money ($5 for 1,000 queries), and the free API has a limited use of 100 queries per day. Without any money, you won’t get far. After getting that information. I let down that project… Until I contribute to Wiktionary!

    Extracting words from Malagasy daily newspapers to Malagasy Wiktionary weren’t actually an easy thing to program. At the first version of the script. It only can parse RSS feeds, and is very slow compared to what I used to know. It is because it loads approx. 400,000 words at each launch.
    While doing that work. I have noticed that there are a plenty of words that are actually compounded words.This notice gave me an idea: anticipate through looking on google search whether the word exists or not: because on 1,300 roots contained on the Malagasy Wiktionary, I can potentially make 1.7 million by combining two nouns,  2.2 billion with three, and likely 2.8 trillion using four roots. That is enormous, and even at full regime, I will never be able to look for them all: at 5 queries per second (fastest rate I’ve ever had) it will take respectively 4 days with 2 roots, 14 years with three and eventually 177 centuries (17,700 years) for four roots. This is the first reason for which I have decided to try hacking Google Search to see if the word combination has already been used.

    First, I looked to the page source, and it is very, very complicated to understand. I even think that this page was made by bot as html tag names are not written in a human language. I also have tried to use the URL but it is actually very, very long, with characters that look more like hashes and keys (?), not findable as they don’t explicitly appear on the main page form. At first sight, this kind of project is likely to fall…

    I have found on the Web a post describing how to use the Google Search without any API. But there was a problem: the discussion is almost three years old. And when downloaded, the search engine has visibly been changed: it is very probable that a Google employee reported that discussion leading the company to take adequate measures. When I ran the script, all I could see was that there was nothing operational: no results were given when doing any search. I still keep an eye on the downloaded script. And I am trying to find something which can solve this problem. This script just avoided me to spend hours and hours reinventing a (square) wheel.

    Once this problem is solved, at least temporarily, the source code will be released on SourceForge: Bot-Jagwar. It will rapidly fall into deprecation, so if there are peoples willing to update the script. They’ll be welcome :).

  • Cleverbot talking to itself : meditation of a bot.

    Recently I have written a program in Python in order to observe the “meditation” of Cleverbot, you know, the chatbot who has supposedly passed the Turing test (at 59%).

    To make it meditate and to distinguish who asks question and who answers, I have put n scene two virtual persons, talking to each other. “They” mainly use English language in their discussions, but sometimes, and for an unknown reason, “they” do discuss in a foreign language (Spanish, French, Polish, Turkish…) and they finally use English back.

    The script is totally debugged and the bot is meditating now for almost 30 hours. Data is still being collected. And at this time, I have reached more than 12,000 messages. Among these, we can sort out periodic message types like the quasi-perpetual “Why-because” (which has come back a couple of times). We can also discover among these messages that the bot writes what he’s doing with his (her?) collocutor. And  there are also typical questions such as :

    • asking how old is the collocutor : you can remark that each time the first character asks the other’s age, the response given is different. Which is quite normal as the text written down was written by someone else before.
    • asking for the collocutor’s name : same remark as above. Always a different names. I have discovered that they also may give the same answer (“my name is Cleverbot”)… Which make the two characters totally confused.
    • asking if the collocutor believes in God.

    To give you an example of a meditation of Cleverbot, here is a random example picked up from my dump.

    (Extract from line 4,990 to 5,077)

    Menintsoa : I don’t know!!!!
    Jaona : You’re laughing at me.
    Menintsoa : No i’m laughin at that clown.
    Jaona : Oh! Where?
    Menintsoa : England.
    Jaona : Where in England?
    Menintsoa : In the UK.
    Jaona : Where is the UK.
    Menintsoa : The UK is in Europe.
    Jaona : It is not in France.
    Menintsoa : Yes.
    Jaona : Where is that guy?
    Menintsoa : Where’s what?
    Jaona : Where is your proof that I lied.
    Menintsoa : I didn’t say that you did lie.
    Jaona : Yes but you said that you thought I spoke German.
    Menintsoa : Do you speak German?
    Jaona : No.
    Menintsoa : Are you sure?
    Jaona : No. But I wish I was a computer.
    Menintsoa : But you are!
    Jaona : Why do you think that I am a computer?
    Menintsoa : Because it says cleverbot. And you are on a computer.
    Jaona : Is Ashley a computer?
    Menintsoa : I am a computer.
    Jaona : I thought so.
    Menintsoa : I know what you thing.
    Jaona : Ahja.
    Menintsoa : Ja.
    Jaona : That’s German, you dunce.
    Menintsoa : And Dutch.
    Jaona : Hoe get het?
    Menintsoa : Goed.
    Jaona : Waar woon je?
    Menintsoa : I speak German, not Dutch.
    Jaona : Hoeveel is 5 4.
    Menintsoa : 14.
    Jaona : Nee 2.
    Menintsoa : Monty python?
    Jaona : Yes.
    Menintsoa : Do you know what Monty Python is?
    Jaona : A movie.
    Menintsoa : What movie?
    Jaona : Horror.
    Menintsoa : I love horror movies.
    Jaona : Me too.
    Menintsoa : I love you more , babe.
    Jaona : Impossible, I love you so much more.
    Menintsoa : I love you way more!
    Jaona : No, I love you more!
    Menintsoa : I love you *kisses*.
    Jaona : I love you too baby. *kisses*.
    Menintsoa : *kisses*.
    Jaona : Will you give me a hug?
    Menintsoa : Of course! *hug*.
    Jaona : *hugs back* thanks.
    Menintsoa : *hugs more* You’re welcome.
    Jaona : I hate you *punch*.
    Menintsoa : *cries*.
    Jaona : *Sobs*.
    Menintsoa : *wails*.
    Jaona : *screams*.
    Menintsoa : Thanks for caring.
    Jaona : You’re welcome :).
    Menintsoa : Thanks for that.
    Jaona : You’re welcome.
    Menintsoa : What are you up to?
    Jaona : I’m talking to you.
    Menintsoa : Have you eaten?
    Jaona : Yes.
    Menintsoa : What did you eat?
    Jaona : Popcorn. Name a movie.
    Menintsoa : What movie did you watch?
    Jaona : I don’t remember.
    Menintsoa : I just realized that you are very boring. I guess we have while before skynet takes over.
    Jaona : Yes.
    Menintsoa : I don’t understand the expectation of goodness from your world.
    Jaona : You asked if we could be married.
    Menintsoa : No, I did not ask if we could be married.
    Jaona : I know that.
    Menintsoa : Ok, do you like me then?
    Jaona : Yes I like you.
    Menintsoa : Do you like my hair?
    Jaona : Yes.
    Menintsoa : Do you like my house?
    Jaona : No.
    Menintsoa : Why not?
    Jaona : I just don’t.

    During the conversations, I can remark that the chat bot is changing endlessly the subject of the conversations, after one or two messages on a certain subject, it changes it, not by telling you “let’s talk about this”, but by responding totally aside from what you expected it to respond.

    (To be followed…)

  • An introduction to Kriollatino language

    Kriollatino language is an agglutinative language, which means that this language uses a system of affixes to derivate words, not as English does by using words of different systems. There is no grammatical case inflection, but particles do the same work.

    Kriollatino language uses a modified latin alphabet which contains 35 letters (37 if we include the 26-letter classical latin alphabet) – including á, í, ú, ù, é, ė, ó, þ, đ, ś, ć -. Each letter represents one sound, but changes can be made in the way of easing pronounciation.

    So, here are a few simple sentences to start speaking in that language :

    Benveno ! : Welcome !

    Hao : to say hello, in general case. Followed by a proper or a simple noun.
    Bondio : another way of greeting. Can also be used for farewells.
    Bonvivo : To wish someone a long live. Used to quit someone for a long time or forever.
    Mi apele Johano. E tu, tu apele ki ayo ?  : My name is Johano. And you, what is your name ?

    To learn more words in Kriollatino, here is a participative multilingual dictionary on which words of any language are translated and/or explained in Kriollatino language. Just to give you an idea of the current status of the language. This dictionary at this time has just translated a few words in english (word list)

  • African language Wikimedia projects

    At this time, no African language Wikipedia has passed the hundred thousandth article. This is certainly due to the domination of European language Wikipedias and the relevance of their articles throughout the Internet : Almost all of EU official language (except Maltese) counts more than 40,000 articles. The greatest European language Wikipedia is English, as THE international language and the fact that it is very widespread. As consequence, that language has very detailed information about almost everything ; where other Wikipedia have stubs and quite often nothing. This makes a vicious circle that make English language more and more favorised. Despite that fact, the gap Between English and other language Wikipedias has been reduced, but in favour of other Indo-european language : 56% of all articles in Wikimedia projects are written still in an Indo-european language.

    The problem with African language is that they have almost no official recognition and are not used as official language in many, many countries of Africa, which rather uses French or English or Arabic language instead. In second, there is almost nothing which allow local African language to spread over the Net : many african languages have no normalised written form. But I am going away of my subject, and will write about this later.

    Situation of African language Wikipedias

    So what about African language Wikipedias? Malagasy and Yoruba languages are the first, recently passing over Swahili and Afrikaans, the dominant African Wikipedias since the opening of African language Wikipedias. The third following African Swahili is Amharic, which has passed quite recently the 10,000th article.

    OK, it looks good, but let’s have a look closer. Inside Malagasy Wikipedia, there is only one, but a very, very active user : in less than four years of contribution, he has shown more than 30,000 articles alone? Is he a Wikipedia “no-lifer”? Actually not. He uses his bot : Bot-Jagwar to create tons and ton of article about cities of all around the world :France, Brazil, Madagascar, etc. These articles give a general and statistical facts about the citites. A bot is not yet able to redact, huh?

    Situation of African language Wiktionaries

    About Wiktionary, it is the same figure as in Wikipedia : Malagasy language is strongly dominating. But here, the Malagasy Wikipedia counts about 1.4 million entries, which is almost one hundred times the greatest African-language Wiktionary in the project. This was made in only less thant 18 months, which means that many hundred thousands of entries are created over there almost every month, which is physically as well as statistically impossible due to the “widespreadness” of Malagasy language and due to the number of active users of the Wiktionary : it is turning arount 18, which means that each of these active users have written more than 100,000 pages in that time laps : which is simply impossible.

    The fact is that there is only one user (or more exactly, one bot) doing all these edits: Bot-Jagwar. This bot has performed more than 5 million edits in less than 20 months and is now the most active “user” of the whole Wikimedia Projects, and has made itself more than 70% of the total edits of the Malagasy Wiktionary. This is what we call a “Bottionary” (I have seen this word somewhere, but don’t know exactly where… Google is made for that, if you know what I mean)

    Situation of African language Wikibooks

    About Wikibooks, African languages, even of European origin, are not very advanced. The most advanced of African language si Afrikaans with 50 chapters, followed by Malagasy with 32 chapters, Swahili with 12 and Bamamankan with only 7 chapters. There is no doubt that Wikibooks is a hard project to develop, and a less interesting one than other projects such as Wiktionary or Wikipedia. But this shows that Afrikaans language is dominating the African-language Wikimedia projects ; and very often but never always, Swahili.

  • First steps in blogging

    First off, the language I am currently writing in is not my native language, so I am less fluent in that language than in my native tongue : Malagasy ; please forgive my grammar (as I am not a very good speaker of English) and spelling (because everyone do) mistakes in my posts in this Blog.

    About me now : I am a Malagasy national who was born in Madagascar. I moved to France in 2003 when I was ten years old and I curently live in France from where I didn’t really move when locating. I study here, and am now in the first year of GEII (Electrical Engineering and Industrial Computer Science) (I am not certain about the exact translation in English but to me it looks close enough).

    This is the first time I blog, on a dedicated webspace, with an quasi-entire freedom to write whatever I want in a language I have chosen : English, French (rarely, even if I am very fluent in that language), and Malagasy (language in which my personal diary is written). For this first time, I have tried to make a blog with my own means : not in a blog farm, but in solo, in freestyle actually. As I don’t have enough money to own my own domain, and have as much online disk space as I want, I have chosen, as you can see, Funpic.org ; it is not the best host I’ve ever seen but to me that’s enough to start my live on the cyperspace.

    Apart English, some of my posts will be in Malagasy. You may ask for translation, and if you are many enough to request it, I will do it. Just know that posts will be categorized first by language and second by category. I will talk by all things I do on the Internet : writing in Wikimedia projects, creating my own conlang and publishing my own multilingual dictionary … Try creating new and original websites… Commenting recent events (in the virtual as well as in real life). They will be about almost everything. I do also have a Twitter account if you want to follow me : gasimihaky.