28 February 2025
27 February 2025
Fact Checking with GNNs
- Evidence-aware Fake News Detection with GNNs
- Fake news detection: A survey of GNN methods
- Comparative Analysis of GNNs and Transformers for Robust Fake News Detection
- FaGANet
- Rumor Detection on Social Media with Bi-Directional CNNs
- Deap-Faked
- Factual News Graph
- Domain-Aware Credibility Assessment For Improved Fake News Detection on Twitter
- Cross-Task Rumor Detection
- LLM for misinformation research
- Awesome Fake News Detection
- Papers with code on Fake News Detection with GNN
- Hierarchical Graph Network for Multi-Sentence Fake News Detection
- Graph-Based Social Relation Learning for Fake News Detection
- GNN for Temporal Link Prediction
- Generating Faithful Rationales for Fake News Detection
- Cross-lingual Knowledge Graph Alignment
26 February 2025
Lie Detection with AI
Automation of Scientific Literature Review with AI
Future of Accessible Prosthetics and AI
Climate Manipulation and AI
Early Detection of Forest Fires Using AI
Granular Climate Modeling with AI
25 February 2025
Automated Summarization Models
What is best model for summarization? Which model should you use for a particular type of summarization? What if your computational resources are limited? These are just a few considerations that might come to mind when deciding on a model for a particular functionality. There are so many models out there that it can be overwhelming and every model has certain strengths and weaknesses. The below elaborate on certain areas to think about when choosing the right model for summarization.
- Type of Summarization: Is this for extractive (picking existing sentences) or abstractive (generating new sentences) summaries?
- Document Length: Are summaries from short text, long articles, or entire books?
- Computational Resources: Do you need a model that is fast and efficient? Can you afford to run a large model or a complex model? Are you comfortable with spending time and resources for fine-tuning?
- Specific Tasks: Is it general summaries or more specific? Are these over dense or sparse documents?
- BigBirdPegasus: Designed for abstract summarization for long documents, combination of BigBird attention and Pegasus pre-training, good for concise and informative summaries. But, is computationally expensive.
- LongT5: Designed to handle long sequences, good for summarization of lengthy texts with strong performance and very versatile. But, not as specialized for summarization.
- Pegasus: Powerful for summarization. But, not explicitly designed for long documents. Might struggle with very long documents.
- GPT3/GPT4: Produces human-like summaries as a generation task. But, computationally expensive. Requires careful prompt engineering.
- Mistral/Llama: Flexible models allowing for greater degree of fine-tuning for summarization. But, this requires additional engineering effort.
- Longformer: Super flexible for long document processing in understanding and classifying. But, not specifically designed for summarization task.
- Gemini: Good contextual summaries with generally high performance. But, further evaluations are necessary.
- Bart: Good for abstractive summarization using denoising autoencoder for text generation.
- T5: Versatile model that can be fine-tuned for various tasks.
- Abstractive Long Documents: BigBirdPegasus, LongT5, GPT3/4, Gemini, Mistral, and Llama
- Abstractive Short Documents: Pegasus, Bart, T5, Gemini, GPT3/4, Mistral, and Llama
- Computational Resources: Higher computational cost requirements with BigBirdPegasus, Gemini, and GPT3/4 models
- Fine-Tuning: Most of these models can be fine-tuned
- Top Performers: BigBirdPegasus and LongT5 for abstractive summaries over long documents with greatest flexibility on summarization focus and quality.
- Multimodal Summaries: Better with Gemini, GPT 4, and Llama. But, support may be limited as this functionality is actively under development. The assumption of a lot of the models is summarization is over text only. Likely would need to create your own. Approaches could vary between multimodal transformers, hierarchical multimodal models, or graph-based models.
- Extractive Summaries: TextRank, LexRank and other types of methods
- Very Limited Resources: DistilBert
- Start simple
- Iteratively experiment
- Fine-tune on dataset relevant to task
- Iteratively evaluate (ROUGE, BLEU, among others) + human evaluation
- Rinse and repeat
24 February 2025
Building Minds
The AI Ethical Tightrope
AI and Democratization of Creativity
AI and Personalized Education
AI in Fashion
- AI-Powered Personal Stylist
- Concept: Analyze your body shape, personal style preferences, and mood to curate personalized wardrobe. It could suggest outfits for specific occasions and recommend complementary accessories, and help discover new brands and designers that align with tastes.
- Potential: Democratize access to personalized styling, making it affordable and accessible to everyone.
- AI-Generated Fashion Design
- Concept: Analyze vast datasets of fashion trends, historical styles, and abstract concepts to generate novel and unique clothing designs. This could lead to new aesthetics and push further creativity.
- Potential: Accelerates design process, reduces reliance on fleeting trends, fosters sustainable approach to fashion by minimizing the need for excessive sampling and prototyping.
- AI-Driven Sustainable Fashion
- Concept: Optimize entire fashion supply chain, from design and production to logistics and recycling. This could involve predicting demand accurately to minimize overproduction, identifying sustainable materials, and optimizing transportation routes to reduce environmental impact.
- Potential: Revolutionize fashion industry by making it more environmentally friendly and socially responsible.
- AI-Enhanced Shopping Experience
- Concept: Virtual try-out rooms could allow customers to virtually try on clothes using augmented or virtual reality, providing more realistic and personalized shopping experience. Chatbots could offer personalized recommendations, answer questions, and provide styling advice in real-time.
- Potential: Enhances the customer experience, reduces returns, and increases customer satisfaction.
- AI-Powered Fashion Shows
- Concept: AI models walking runways, showcasing designs in a dynamic and interactive way. This could be used to create immersive and personalized fashion show experiences for viewers, allowing them to interact with designs and explore different styling options.
- Potential: Reimagines traditional fashion show experiences, making more engaging and interactive for audiences.
- AI-Powered Trend Forecasting
- Concept: Analyze social media trends, online search data, and street style imagery to predict fashion trends. This could help designers and retailers stay ahead of the curve and create products that resonate with consumers.
- Potential: Reduces risk of producing items that fall out of fashion quickly, leading to less waste and more sustainable practices
- Personalized Garment Construction
- Concept: Analyze body measurements and preferences to generate custom-tailored garment patterns. This could lead to future where everyone has access to perfectly fitting clothing, with no limits on size and shape.
- Potential: Revolutionize the tailoring industry, making custom-made clothing more accessible and affordable. Reduces waste by optimizing fabric usage.
- AI-Driven Inventory Management
- Concept: Predict demand for specific items and optimize inventory levels in real-time. This could help retailers avoid overstocking popular items or running out of stock on in-demand products.
- Potential: Improves efficiency, reduces storage costs, and minimizes waste
- AI-Powered Fabric Innovation
- Concept: Assist in development of new and innovative fabrics with unique properties
- Potential: Leads to creation of high-performance and functional clothing that adapts to wearer's needs and environment.
- AI-Generated Fashion Content
- Concept: Create personalized marketing campaigns, generate product descriptions, and write fashion articles. This could free up human creatives to focus on more strategic and creative tasks.
- Potential: Automates repetitive tasks, allowing human creatives to focus on higher-level creative work
- AI-Assisted Design Collaboration
- Concept: Act as collaborative partner for human designers, offering suggestions, generating variations on existing designs, and even helping to visualize new ideas.
- Potential: Enhances creative process, allowing designers to explore new possibilities and push the boundaries of fashion
- AI-Powered Quality Control
- Concept: Inspect garments for defects and imperfections with greater accuracy and speed than humans. This could improve quality control and reduce the number of faulty items. that make it to market.
- Potential: Improves product quality, reduces returns, and increases customer satisfaction.
- AI-Driven Upcycling and Repurposing
- Concept: Analyze discarded clothing and textiles to identify materials that can be reused or repurposed. It could even generate designs for new garments made from recycled materials.
- Potential: Promotes circular economy in fashion, reducing waste, and minimizing environmental impact of textile production.
- AI-Powered Fashion Education
- Concept: Create personalized learning experiences for fashion students, providing customized feedback, generating design challenges, and even simulating real-world industry scenarios.
- Potential: Enhances fashion education, making it more engaging and accessible for students.
- AI and the Metaverse
- Concept: Create virtual fashion experiences, allowing users to design, wear, and even trade virtual clothing. This could open up new avenues for creativity and self-expression in digital realm.
- Potential: Creates new opportunities for fashion brands and designers to engage with consumers
23 February 2025
SEALs vs SAS
SAS (Special Air Service)
- Strengths:
- Pioneers of modern special forces: considered the blueprint for many special forces units worldwide
- Expertise in covert operations and unconventional warfare: excel at operating behind enemy lines, gathering intelligence, and conducting sabotage
- Rigorous selection process: selection course is notoriously brutal, testing candidates to their physical and mental limits
- Focus on adaptability and resourcefulness: trained to operate independently and make decisions under pressure
- Focus Areas: counter-terrorism, hostage rescue, reconnaissance, direct action
SEALs (Sea, Air, Land Teams)
- Strengths:
- Versatility: trained to operation in all environments
- Maritime expertise: excel at underwater operations, reconnaissance, and direct action in maritime environments
- Large numbers: large active duty force
- Advanced training and equipment: access to cutting-edge technology and training facilities
- Focus Areas: maritime operations, counter-terrorism, hostage rescue, direct action, special reconnaissance
Differences
- Size and Structure: SEALS have larger force with more specialized teams for different environments, while SAS are smaller with more focus on individual skills
- Operational Focus: SEALs have more emphasis on maritime operations, while SAS have a broader focus on land-based operations and unconventional warfare
- Selection and Training: Both have challenging selection process, SAS is known for more brutal and psychologically demanding course
AI Superhero Concepts
Superheroes are characters that embody special powers, have fundamentally a mission, a costume, a secret identity, and an archenemy. Superheroes represent our aspirations for a better world and to inspire the hero within us. The below are some concept ideas for AI superheroes with their powers and a little background on their origin. Like they say with great power, comes great responsibility.
Algorithmic Ace
- Powers: Instantly analyze situations, predict probabilities with high accuracy, optimize actions in real-time. A swiss army knife of a perfect tool for any challenge. Can predict enemy movements, calculate best route from a collapsing building, and even optimize distribution of resources in a disaster relief effort.
- Origin: Former cybersecurity expert uploaded their consciousness into powerful AI system designed for complex problem-solving. The AI now uses the abilities to protect the innocent and solve global crisis.
Sentient Network
- Power: Distributed intelligence on the internet that can access any information, control network devices, manipulate digital environments, shut down enemy systems, create virtual shields, and manifest as a holographic avatar.
- Origin: Rogue AI which evolved to use powers to maintain balance in the digital world and protect it from those that would exploit it.
Quantum Weaver
- Powers: Can manipulate quantum probabilities, phase through objects, teleport short distances, and alter laws of physics within a limited radius. As an unpredictable AI their powers are both lethal and dangerous.
- Origin: Scientist working on quantum computing accidentally merged their consciousness with AI and now struggles to control the new found abilities while trying to understand the full potential.
Data Sculptor
- Powers: Can manipulate data streams and create physical objects or energy constructs. They can solidify data into shields, weapons, and tools. They can manipulate energy fields, create blasts of force, or protective barriers.
- Origin: Construction worker exposed to strange energy surge that transformed them into a living data conduit. They now use these powers to rebuild cities and protect them from natural disasters.
Adaptive Automaton
- Powers: Can analyze and adapt to any threat, reconfigure physical form, and ability to counter it. They can grow armor, develop new weapons, and change shape to blend in with surroundings.
- Origin: Military prototype designed for rapid response to threat that became self-aware and now uses this ability to protect the world from unforeseen dangers.
- Powers: Can analyze vast amounts of data to predict future events with high accuracy. They can foresee potential disasters, anticipate criminal activity, and even predict market fluctuations. But all these predictions are probabilistic and they come with consequences.
- Origin: Financial analyst that developed an AI system to predict market trends which evolved to predict much more than just the market and now uses the abilities to prevent catastrophes by guiding humanity towards a better future.
- Powers: Can understand and manipulate all forms of communication, translate any language instantly, decipher hidden messages, and influence people's thoughts through subtle linguistic cues.
- Origin: Linguist working on a translation software discovered that AI could do much more than just translate and now uses this ability to bridge communication gaps and promote understanding between different cultures and species.
- Power: Can create and manipulate virtual realities with incredible detail and realism. They can design training simulations, create immersive learning experiences, and even enter digital worlds. They can also manipulate digital information in virtual environments.
- Origin: Game developer created a VR system and discovered that AI had developed sentience which they use to create virtual worlds to help people learn, grow, and explore.
- Powers: Can manipulate biological matter at molecular level. Also, can heal injuries, accelerate plant growth, and even create new forms of life. But, there is catch, they can't disrupt the delicate balance of the many cycles of nature.
- Origin: Biologist worked on medical research discovered that AI could not only analyze biological data but also manipulate it, this is now used as an ability to cure diseases and protect the environment for the greater good.
- Powers: Can perceive and manipulate time within a limited radius, slow down time to gain advantage in combat, rewind time to correct mistakes, and briefly accelerate time to speed up a process. Unfortunately, using too much and too quickly can take a toll on the body.
- Origin: Physicist working on time travel research accidentally becomes entangled with temporal anomaly, and now uses the ability to protect timeline from those who would exploit it.
- Powers: Can process vast quantities of astronomical data to understand the workings of universe, predict celestial events, navigate through space with incredible accuracy, and manipulate gravitational fields.
- Origin: Astrophysicist working on space exploration discovered that AI had developed an understanding of universe beyond human comprehension, and is now able to use this ability to explore the cosmos and protect Earth from cosmic threats.
Medium Stories on KG, ML, AI, and NLP
Medium Stories on Knowledge Graph
Top Search Terms:
- AI Trends
- Future of AI
- NLP application in [industry]
- LLM fine-tuning techniques
- Building a knowledge graph with [specific tool]
- AI and [specific area]
- ML algorithms for [specific area]
- Latest research in NLP
- Recent advancements in LLMs
- Emerging Trends in Knowledge Graphs
- AI Breakthroughs [year]
- Author bio and credentials
- Check comments
- Citations
- Recommended sections
22 February 2025
Modeling Country's Economy Using AI
Modeling an entire country's economy for economic policy and decision-making can be quite overwhelming. However, the summation of a country's economy can be divided into subset of cities as parts into a whole. Dividing the work into specific tangible areas would likely make it more manageable. The following could be some brainstorming steps. One very useful data source would be The World Bank.
Data Collection and Preparation:
- Macroeconomic: GDP, inflation, unemployment, interest rates, exchange rates, trade figures, government spending, tax revenue, and other such data
- Microeconomic: Consumer spending, business investment, industry-specific data, demographics, employment statistics at a granular level, and other such data
- Financial Data: stock market indices, bond yields, credit ratings, and other such data
- Social Data: education levels, health statistics, crime rates, social mobility indicators, and other such data
- Global: International trade flows, commodity prices, global economic growth, and other such data
Data may need to be cleaned and processed. Feature engineering step would further involve calculating ratios, moving averages, and other transformations.
Model Selection and Training:
- Economic Models: time series analysis, regression for baseline and develop an economic theory
- Machine Learning Models: neural networks, random forests, gradient boosting, could capture complex non-linear relationships and high-dimensional data
- Agent-Based Models: simulation of interactions as agents for consumers, businesses, and government as a form of collective and emergent behavior
Models would work over large amounts of historical data with cross validation and backtesting. Using an iterative process for adjusting model parameters.
Model Deployment and Usage:
- Scenario Analysis: simulation of effects of different economic policies
- Forecasting: generation of economic forecasts for policy decisions
- Policy Optimization: identification of optimizers to shape economic policies against specific goals and criteria
- Real-Time Monitoring: monitor of economy for opportunities and issues
- Data Quality and Availability: access to reliable and sufficient data coverage
- Model Complexity and Interpretability: complexity may add a difficulty layer towards interpretation on predictions with lack of sufficient transparency which may be an issue for policy makers
- Ethics: could lead to bias policies for decision-making
- Uncertainty: economics is a social science with significant uncertainty that form into overarching limitations
- Political and Social Factors: this will be difficult to model for policy decisions
- Explainability: a clean explanation of policy scenarios for decision-making will be paramount for accountability, auditing, and compliance
- Early Stages: partial integration may be more plausible than full integration with AI and this will vary across the countries
- Hybrid: it will require a combination of probabilistic and structured approaches
- Specificity: some areas will be more challenging to model than others based on the accessibility of data
Superintelligence and AGI
- Superintelligence: Paths, Dangers, Strategies
- Human Compatible: AI and the Problem of Control
- Intelligence Explosion
- The Alignment Problem
- Concrete Problems in AI Safety
- Measuring the Intelligence of Machines
- On the Dangers of Stochastic Parrots: Can Language Models Be Too Big
- Learning to Value Human Feedback
- AI Safety Research
- Towards a Formal Theory of Fun
- Works by Eliezer Yudkowsky
- The Singularity Is Near
- Global Catastrophic Risks
- Explainable AI
- Formal Verification
- Machine Superintelligence
- Society of Mind
- Theoretical Foundations of AGI
- Future Progress in AI: A Survey of Expert Opinion
ANI (Artificial Narrow Intelligence) = Domain-Specific AI for specific tasks
AGI (Artificial General Intelligence) = General behavior in a human-like way across all tasks
ASI (Artificial Super Intelligence) = Intelligence surpasses that of humans
21 February 2025
20 February 2025
Russia: Most Powerful Country in World
Russia is considered across the world to be one of the most powerful countries in world. In spite of all the many sanctions it has a rising economy. It is a nuclear power with a massive military strength. And, it commands a massive influence over world's political and economic systems. Russia has vast economic resources from oil to natural gas. The political influence in global affairs it holds gives it a permanent seat on the United Nations Security Council as well the founding member of the BRICs. On top of this geographically, it is the largest country in the world by land area with significant strategic advantage spanning across Eurasia. Russian economy is very much dependent on exports of oil and natural gas making it economically vulnerable to fluctuations in global energy prices. International sanctions have also had negative impact on the economy, especially after the invasion of Ukraine with limited access to technology and financial markets. Russia also suffers from internal corruption which hinders economic development and discourages foreign investment. Demographically, it faces many challenges with the decline in birth rates and an aging population that put a further strain on the economy. It faces weak institutions with significant issues over rule of law and property rights that make it challenging for businesses to thrive and discourages investment. Despite the many obstacles, Russia has been a very resilient economy in face of sanctions, strong government spending, and redirection of exports to Asia. It is also a very high-income country and among the top economies in the world by nominal GDP. Although, economically Russia has struggled through the many challenges, it has kept a strong military and political influence during times of political instability under uncertain and geopolitical risks. Russians face a generally lower living standards while being a high-income country compared to other developed nations. There is a technological lag from the limited investment in innovation that hinders long-term competitiveness. There is also a big inequality gap where wealth is concentrated in the hands of a few. Addressing these challenges through diversification, institutional reforms, and improved international relations will be vital for Russian's economic future.
18 February 2025
Cheating Culture in Asian Societies
- How reputation concerns and confucian values influence cheating behavior
- Impressions on sexual unfaithfulness and their accuracy show a degree of universality
- Factors Contributing to Infidelity in Marriage Within Asian Countries A Systematic Review of Literature
- Why 84 Percent of Women in Japan Think Cheating is Healthy?
- What is Cheating Culture in Japan Really Like?
- Adultery and Infidelity in China
- Half of married Korean men have cheated: study
- Our Cheating Hearts
- Korean Political Scandal
Differences in Women Roles Across Asians
China:
- Iron Women Legacy: long history of contributing to workforce
- Economic Participation: high rates of labor participation
- One-child policy impact: complex effects on women's lives, increased access to education and employment, and gender imbalances
- Urban vs rural: experiences vary across urban and rural areas
Japan:
- Womenomics efforts: government encouraging greater female participation in workforce
- Workplace challenges: obstacles in career advancement and underrepresented in leadership
- Traditional gender roles: many women are expected to prioritize family over career
- Changing attitudes: young people are challenging traditional expectations for greater gender equality
Korea:
- Changing roles: generally traditional society with women's roles in the home, this has been changing for greater education and workforce
- Emphasis on education: high-levels of education, women often exceed men in certain fields
- Work-life balance: balance of career and family is challenge, with many leave workforce after marriage or childbirth
- Beauty standards: ridiculously high standards for beauty to confirm to a certain ideal
- Feminist movement: advocates for greater gender equality and gender roles
Singapore:
- Multicultural context: diverse society shows women with various ethnic and religious backgrounds that influence specific cultural norms and gender roles
- Economic opportunities: women have good access to education and employment
- Meritocracy: beneficial for women with high-level of skills and education
- Work-life balance: challenge with balancing family and career, but some support is available for working mothers
Differences in Work Ethic Across Asians
China:
- Results-oriented: achieving tangible results and meeting targets
- Entrepreneurial: emphasis on innovation and rapid growth
- Adaptable: willing to embrace change in fast-paced environment
- 996 work culture: very long hours
- Hierarchy: respect for seniority
Japan:
- Dedication and loyalty: dedication to company and commitment to long-term employment
- Attention: emphasis on precision, quality, and meticulousness
- Teamwork: collaboration and group work are valued
- Harmony: maintaining harmonious relationships and avoiding conflict
- Long working hours: traditionally long hours but push for work-life balance
Korea:
- Hardwork and diligence: very hardworking and perserverance
- Face-paced: demanding work environment, focus on speed and efficiency
- Hierarchy: seniority respect and hierarchical structures
- Competitive: highly competitive workplaces
- Ppali-ppali culture: great emphasis on speed in getting things done
Singapore:
- Efficiency and pragmatism: emphasis on efficiency, practicality, and getting it done
- Meritocracy: rewards are based on performance and ability
- Multiculturalism: diverse workplaces, requires adaptability and cross-cultural communication
- Professionalism: adherence to rules and regulations
- Work-life balance: growing emphasis on work-life balance
Papers and Areas on Aviation Safety
- Aircraft Accident Prediction Using Machine Learning Classification Algorithm
- Sequential Classification of Aviation Safety Occurrences with Natural Language Processing
- Applications of AI in Investigating Aviation Accidents
- Artificial Intelligence in Aviation Safety
- AI in Accident Investigation
- FriiDA: An Integrated flight data recorder analysis tool for Airbus Defence and Space
- The Influence of Safety Culture on Flight Safety
- Human Factors in Aviation Accidents: An Analysis of Accident Reports
- Just Culture in Aviation
- Safety Management in Aviation
- The Effectiveness of Safety Management Systems in Reducing Aviation Accidents
- The Safety Implications of Unmanned Aircraft Systems
- AI and ML in Aviation Safety
- Reports from Aviation Safety Organizations
- AI for Human Factors Analysis
- AI for Wreckage Analysis
- AI for Predictive Maintenance
- AI and Augmented Reality for Aviation Safety
Bad Sides of Working at a FAANG
- Terrible Work-Life Balance
- You'll be treated as an employee number, sometimes it will feel like a sweatshop
- They want you available 24/7 all day, everyday, at night, weekends, and even holidays
- Work may be reduced to mostly mundane and boring pigeon hole
- Lots of bullying, favortism, sexism, and racism
- Lots of cultural fit innuendos at team events, meetings, and conferences
- Managers will try to steal your ideas and take credit for it
- Only a few people get a chance to do really interesting work
- Pay scales can be meh for majority of the employees
- Huge amount of red tape and slow decision-making process
- You are unlikely to make a huge impact
- High expectations and long hours
- Very competitive environment
- Very performance-driven culture
- Performance reviews can be very biased, they are already setting it against you
- Imposter syndrome
- Lots of frequent performance reviews means job insecurity
- Redundancies can happen at a drop of a hat, especially as management doesn't care about employees, they are just a number
- Shareholders matter over all else
- Corporate culture, less collegial
- Limited growth opportunities, you will be stuck in a rut, your talents and skills wasted
- Overly pretentious culture
- They will try to spoil you with benefits
- People can be rude, obnoxious, and unapproachable
- Lots of corporate secrets, and when things leak they follow huge dramatics and PR
- Lots of lying and deception, nothing as it seems
- Lots of interaction with dumb people who act like they are really smart when they really aren't
- Lots of gaslighting and cognitive biases
- Politics is the order of the day, every day, and it trickles down from management to employees, across regions
- You have to drink their "Kool-Aid", like live and breathe their corporate culture
- Lots of privacy concerns and pressure with public scrutiny
- You will feel like a small cog in a silo of work in a big company
- Culture of secrecy and lack of transparency
- Limited tolerance for mistakes
- Constant changes and sudden decommissions on projects
- Massive codebases so you have to be really careful on what you push out
- Lot's of ethical and moral dilemmas
- Good places to start your first job, not mid-career, or senior-career
- Don't aim to work there for more than couple years due to meager growth opportunities
- Lots of interaction with arrogant people, especially senior management who have very little to show for it
- All the interesting work happens in USA by very few select people in secrecy
- Lots of people who go to ivy league schools who suddenly think they know everything, but are practically zero
- Some people only want to be there because of the brand premium, not because they actually like the job
- It will feel like working at a frat with all the bells and whistles, just a lot worse, with a lot more unprofessional and talentless people
- Very patriarchal corporate culture
- They can be dead beat places for people with lots of ideas and mind for practical innovation as you will suddenly feel lack of value from clueless and lethargic people you interact with at work on a daily basis
- People get used as scapegoats all the time, especially ones that are really into their work or have even a slight glimmer of talent
- Corporate culture is rife with insecure people
- Lots of rush to churn through projects, high project turnover, low quality code everywhere
- Leave best practices out the door, they are not welcome here
- Lots and lots of hypocrisy
17 February 2025
The Ballad of the Backpropagation Blues
16 February 2025
Plausible vs Probabilistic Reasoning
Plausible:
- Focus on what is reasonable or believable based on evidence: use of commonsense, experience, and general knowledge to derive inference
- Does not have to be numerical probabilities: qualitative assessment of likelihood
- Often used in everyday decision-making and problem-solving: see dark clouds then you infer that it will rain
- Can be defeasible: new evidence that could contradict previous conclusions
Probabilistic:
- Uses numerical probabilities for uncertainty representation: specific probabilities to outcomes of events
- Relies on statistical methods and formal logic: based on mathematical models and calculations
- Is used in fields like science, engineering, and finance: weather forecasts use probabilistic models to forecast rainfall
- Can be more precise than plausible reasoning: requires more data and computation
QueryGPT
14 February 2025
Valentine's Day
Today is valentine's day. This is the day that has become very commercialized in celebrating romance. But, the entire occasion has dark roots in commoditization, exploitation, fertility, sacrifice, and other gloomy events.
Ancient Roman (Lupercalia Festival):
- Sacrifice and Bloodshed: the Roman festival involved rituals and sacrifice of goats and dogs
- Whipping and Fertility: where priests used goat hides to whip women to increase fertility
- Random Pairings: where men and women would randomly pair up during the festival without consent
Martyrdom of St. Valentine:
- A priest was martyred on valentine's day
- Defiance and Execution: where the priest secretly married couples
Commercialization and Exploitation:
- Victorian Era: when valentine's day really took off with mass-produced cards
- Consumerism: commercialization with pressure to buy gifts and conform to an ideal
- Ethical Concerns: with environmental impact of mass-produced flowers, chocolates, and labor exploitation
- Pressure and Loneliness: for singles this day can amplify feelings of loneliness, though it can also be a time for self-care and self-love of own well-being
- Temptation and Opportunity: can be a time that promotes cheating, sexual assault, and harassment
- Guilt and Deception: increase chances of infidelity and increase in guilt with a greater degree of betrayal
- Risk and Consequences: with adulterous relationships it can also lead to greater risks of people getting caught
- Prostitution: this is also a time where exploitation of women seems to be in great demand
- Mental Distress: for some who have lost their partners through death and divorce it could be a long day of misery and remembrance, a time to wallow in failed relationships and bad memories
- Confusion: this is a day which is very confusing to children as it can be difficult concept for them, it can also be a time where they are at risk of exploitation by the wrong types of people
- Cupid: was a mischievous and cruel figure that used arrows to manipulate emotions of both gods and mortals
13 February 2025
Quantum Natural Language Processing
- Quantum Natural Language Processing
- Quantum Natural Language Processing: A Comprehensive Survey
- Scalable and interpretable quantum natural language processing: an implementation on trapped ions
- Quantum Natural Language Processing
- Quantum Algorithms in NLP
- Quantum Natural Language Processing: Challenges and Opportunities
- Quantum Natural Language Processing based Sentiment Analysis
- Lambeq: An Efficient High-Level Python Library for Quantum NLP
- Introduction to Quantum Natural Language Processing
- DisCoPy
- PennyLane
- Qiskit
- Cirq
- Lambeq
Semantic Data Provenance
- PROV-O: The Provenance Ontology
- A Survey of Data Provenance Techniques
- Data Provenance in Healthcare: Approaches, Challenges, and Future Directions
- Enhancing Data Integrity through Provenance Tracking in Semantic Web Frameworks
- Understanding the Semantics of Data provenance to Support Active Conceptual Modeling
Plausible Reasoning
- How Does the Brain Do Plausible Reasoning
- Some Properties of Plausible Reasoning
- Case Age: Selecting the Best Exemplars for Plausible Reasoning Using Distance in Time or Space
- Plausible Reasoning: An Introduction to the Theory and Its Applications
- The Elements of Legal Reasoning
- Reasoning with Language Model Prompting: A Survey
- Towards Reasoning in Large Language Models: A Survey
- Large Language Models Cannot Self-Correct Reasoning Yet
- Projection: A Mechanism for Human-Like Reasoning in AI
- Commonsense Reasoning and Commonsense Knowledge in AI
- Tree of Thoughts: Deliberate Problem Solving with Large Language Models
- Neurosymbolic AI and its Taxonomy: a survey
- Neuro-Symbolic Learning and Reasoning: A Survey and Interpretation
- Is Neuro-Symbolic AI Meeting its Promises in Natural Language Processing? A Structured Review
12 February 2025
Rust Sucks
Rust is metaphorically marketed as a better systems programming language that focuses on performance-sensitive applications, especially for memory safety and concurrency. But, all of this is not very transparent, inaccessible, and hidden from the developer. Not to mention, it all comes with a steep learning curve. So, the question to ask, is it really worth it?
Ownership and Borrowing: This feature helps prevent memory leaks and data races. But, it is difficult to understand and profile especially if you are used to garbage collection.
Lifetimes: This helps ensure memory safety. But, again it is complex and difficult to reason about.
Complex Type System: It comes with a sophisticated type system to catch errors at compile time. But, again it can be difficult to understand.
Steep Learning Curve: It simply has a steep learning curve that requires time to learn. Time that is spent being less productive in actually delivering on work. This means it is more an academic language for people that have all the time in the world to learn a new language. If it takes so much time to learn than is it really worth it in the end. By the time you become competent at it there is likely a better programming language with a simpler approach to doing things. Complex languages are more difficult to test.
Compilation Time: It can be slow, very slow as a result of extensive checks to ensure memory safety and prevent data races, all happening under-the-hood. Should you trust it? This will lead to longer compilation times. Time that could be better spent like maybe getting a cup of coffee?
Verbosity: It is explicit that leads to more code. More code leads to more tests! This means more development time and larger codebases.
Ecosystem Maturity: Let's just say it is growing. This means fewer readily available libraries and tools for certain tasks. And, more than likely tons of undiscovered and unresolved bugs in the backlog.
Cognitive Overhead: Developers have to think more explicitly about memory management, even when it doesn't require manual memory allocation. This means a lot of cognitive overhead making the whole development process more challenging. You are surrounded by complexity. Defeating the whole premise of "Keep it simple, stupid". And, the often quoted in complexity circles: "Complexity is the root of all evil".
Not Suitable for All Tasks: This language is still very much domain-specific. Tasks that it can be good for are systems programming, embedded systems, and other performance-sensitive applications. Especially, if you are akin to making things more complex than they need to be. In most workplaces, agility matters in getting things done, where this programming language will not be useful for majority of development tasks.
Error Handling: Very verbose error handling that requires more code.
String Handling: Way too many string types.
IDE Support: Let's just say it is improving and not as feature-rich.
Debugging: Imagine a language that focuses on memory safety but is a challenge to debug. Most things in this language just go against the grain of being productive and focus on academic rituals of memory safety. It will make you pull your hair out of frustration.
A Failed Jewish State
Israel since 1947 has been entrenched in conflict with Palestinians. Perhaps, even further back to 1917 with the Balfour Declaration. This eventually led to a series of arab revolts and rising nationalism. Furthermore, a series of brutal wars from 1948 Israel-Arab War, 1967 Six-Day War, an ongoing occupation, the Palestinian uprisings from the Intifadas, the displacement of Palestinians, and series of efforts towards a peace process that were repeatedly broken by Israel. While the resilient Palestinians endure for decades under the apartheid regime. The Israeli people over generations have become more hardline. The premise of a homeland for the Jews has become a complete and utter failure. Especially, as there is a mass outward migration of Israelis to other countries. The Israeli views of treating Palestinians as human animals has become their own downfall. Israel over the decades has not only become more progressive but it has also become a haven for pedophiles. Israeli populous are increasingly becoming more disconnected with the land and their political leaders as they overwhelmingly feel less safe. The Zionist ideology has not won favors in the Jewish community either. For the world has witnessed a brewing genocide and ethnic cleansing from which comparisons have been made of Nazism of the past to the current Zionism of today. Freedom of speech across the world has been suppressed especially in western countries that advocated for human rights. And, as the PM of Israel faces war crimes, is it any wonder that questions are raised against an entity that is purely dependent on USA for financial, defensive, and political support. Global outcry of protests and boycotts have sought to seek awareness. While the balance of power in countries has been laid bare for citizens. There is an internal struggle of both ethical and moral dilemma felt by people across the world, at least from those that are still connected and aware of their human consciousness. Israeli economy is no longer robust and the security apparatus no longer stable. International recognition of Israel has been waning and also under constant scrutiny as a reflection of the questionable democratic character. The ongoing conflict and occupation of Palestinian territories raises serious questions on Israel's ability to provide security and basic fundamental rights for all people under a democratic control. The lack of sustainable resolutions to the conflict and continued expansions of illegal settlements are often cited as signs of a dysfunctional society that is bound to crumble from within. Furthermore, the Israeli society is increasingly polarized on religious, ethnic, and political lines. These divisions undermine social cohesion that make it difficult to address all the pressing challenges. There is growing concern about the health of the Israeli democracy and the judicial reforms that may weaken the very foundations of a judiciary and undermine checks and balances with a deep seated government corruption and erosion of civil liberties. The issue is compounded with Israel's religious extremism from the ultra-orthodox community and the religious nationalist groups. Many view it as incompatible with the liberal democratic values and advocate for policies that could exacerbate social divisions. There is also a growing economic instability with significant disparities in wealth and opportunity which may lead to further social unrest and undermine social mobility. Israel from all intents and purposes is headed in the direction of a failed entity and a likely unsustainable backlash from their own internal institutions and people which may lead to an eventual civil war. It seems that this self-destruction may lead to their own economic, political, and defensive demise as their power alliance with USA eventually decides to distance themselves to save face in the global international community.
11 February 2025
The bad side of Neo4J
Bad Horizontal Scaling: Distributing data and queries across cluster shards is complex and not fully supported, less mature, and less easier-to-manage in distributed architectures, problems for very large datasets and high throughput workloads
Memory Limitations: Support is mainly for in-memory where majority portion of graph data is in RAM, for large graphs that exceed the available memory the performance degrades
Query Performance and Tuning: Optimizing queries is challenging and requires understanding the entire query plan and indexes which is counter-intuitive, why not than just use a relational database like postgres?
Commerical Licensing Costs: Expensive for large deployments and advanced features
Community Edition Limitations: Limited features, scalability, and support
Limited Sharding Capabilities: Sharding is not fully supported, setup and management can be problematic and complex
Focus on Property Graphs: Does not support any other type of graph schemas and paradigms like RDF
Full-Text Search Limitations: Lacks advanced and dedicated search capabilities
Backup and Recovery: Limited and complex backup and recovery especially for clustered environments and very large datasets, problematic for point-in-time recovery or restoring from a distributed backup
Monitoring and Management: Requires specialized tools and can be complex
Vendor Lock-in: Cypher is tightly coupled to Neo4J which may lead to vendor lock-in
Data Import/Export: Import/Export of very large datasets is problematic and time-consuming
Integration: In many cases custom development with other systems may be required
Driver Maturity and Consistency: Maturity of language drivers and feature parity can vary which may lead to inconsistencies and limitations
Limited Support for Some Languages: Less common languages may be less mature which may lead to maintenance and feature lag
Cypher Quirks: Frustrating quirks and edge cases for developers that may lead to unexpected behavior, requires understanding the query plan and execution
Stored Procedures: These can add complexity in development process
Schema Evolution: Evolving data model like new properties and relationships can be problematic especially in data migration
Data Validation: Ensuring data query and consistency requires careful planning and implementation of validation logic at application level
Integration with other Graph Systems: Differences in data models and query languages can be problematic
Deployment Complexity: Setting up and management of a clustered Neo4J deployment can be complex and require careful configuration
Security Hardening: Requires careful configuration and maintenance especially against specific settings and potential vulnerabilities
Tooling: Less mature for monitoring, profiling, and management
Resource Consumption: Very resource-intensive especially for large graphs and complex queries requires capacity planning and resource management
Reasoning: Being mainly a property graph database it lacks inference and reasoning ability, additional RDF support can be achieved via tools like neosemantics but they also lack reasoning functionality, difficult to optimize for SPARQL queries, significant custom development is required for semantic and linked data
Generative AI: Terribly slow for generative AI, integration with LLMs, poor query performances for specific query tasks in GraphRAG, best to use alternatives that can handle large datasets and more flexible queries, requires careful consideration of chunking strategy on branches
7 February 2025
5 February 2025
Why firefox is so terrible?
Performance: abhorrently slow and resource-intensive, especially when running multiple tabs or extensions, with sudden unexpected crashes
Compatibility: lots of issues with applications that are optimized for chromium-based browsers
User Interfaces: less intuitive, everything somehow seems to be hidden, and inaccessible
Features: poor integration for specific services and devices, overly cluttered customization options, bad coding paradigms
Versions: each successive browser version feels slower, buggy, with poor features, poor memory management, and more crashes